2026-03-29 10:35:05 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-29 10:35:05 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-29 10:35:05 [auto1.de] INFO: Batch mode enabled: batch 2/2
2026-03-29 10:35:05 [auto1.de] INFO: Starting spider auto1.de
2026-03-29 10:35:05 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-29 10:35:05 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-29 10:35:05 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-29 10:35:05 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-29 10:35:05 [scrapy.extensions.telnet] INFO: Telnet Password: 21e6507e0b341102
2026-03-29 10:35:05 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-29 10:35:05 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.de/task_18_2026-03-29T10_35_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-29 10:35:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 10:35:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 10:35:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-29 10:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-29 10:35:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-29 10:35:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-29 10:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-29 10:35:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-29 10:35:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-29 10:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-29 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-29 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-29 10:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-29 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-29 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-29 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-29 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-29 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-29 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-29 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-29 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-29 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-29 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-29 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-29 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-29 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-29 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-29 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-29 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-29 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-29 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-29 10:35:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-29 10:35:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-29 10:35:06 [scrapy.core.engine] INFO: Spider opened
2026-03-29 10:35:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-29 10:35:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
2026-03-29 10:35:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-29 10:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-29 10:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-29 10:35:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-29 10:35:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-29 10:35:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-29 10:35:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-29 10:35:17 [auto1.de] INFO: Channel: 24h | Page: 0 | totalHits: 6726 | hits on page: 40
2026-03-29 10:35:17 [auto1.de] INFO: Found listing with ID: PY88253
2026-03-29 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY88253%27 HTTP/1.1" 200 None
2026-03-29 10:35:17 [auto1.de] INFO: Scrape type for PY88253: 2
2026-03-29 10:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75c6bbf5-cd1a-5123-a7ef-9c6280ff4c85 with identifier: PY88253
2026-03-29 10:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75c6bbf5-cd1a-5123-a7ef-9c6280ff4c85 with scrape type 2
2026-03-29 10:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75c6bbf5-cd1a-5123-a7ef-9c6280ff4c85 with scrape type 2
2026-03-29 10:35:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75c6bbf5-cd1a-5123-a7ef-9c6280ff4c85, identifier: PY88253
2026-03-29 10:35:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75c6bbf5-cd1a-5123-a7ef-9c6280ff4c85 with identifier: PY88253
2026-03-29 10:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 10:35:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-29 10:35:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 10:35:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 10:35:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-29 10:35:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 10:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 10:35:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75c6bbf5-cd1a-5123-a7ef-9c6280ff4c85 with identifier: PY88253
2026-03-29 10:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75c6bbf5-cd1a-5123-a7ef-9c6280ff4c85 with identifier: PY88253 to the API
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:49:28Z',
 'fuel_type': 'petrol',
 'id': '75c6bbf5-cd1a-5123-a7ef-9c6280ff4c85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY88253',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 243875,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-05',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 FSI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2007}
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY88253%27 HTTP/1.1" 200 None
2026-03-29 10:35:18 [auto1.de] INFO: Saving data for PY88253: {'auction_closing_time': 1774885768.0, 'created_time': 1774637471.782482, 'last_price_update_time': 1774780518.27165}
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY88253') HTTP/1.1" 204 0
2026-03-29 10:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:18 [auto1.de] INFO: Found listing with ID: GE15008
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE15008%27 HTTP/1.1" 200 None
2026-03-29 10:35:18 [auto1.de] INFO: Scrape type for GE15008: 2
2026-03-29 10:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eef62774-b546-5532-8e6c-22f5401805e0 with identifier: GE15008
2026-03-29 10:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eef62774-b546-5532-8e6c-22f5401805e0 with scrape type 2
2026-03-29 10:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eef62774-b546-5532-8e6c-22f5401805e0 with scrape type 2
2026-03-29 10:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eef62774-b546-5532-8e6c-22f5401805e0, identifier: GE15008
2026-03-29 10:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eef62774-b546-5532-8e6c-22f5401805e0 with identifier: GE15008
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-29 10:35:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 10:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eef62774-b546-5532-8e6c-22f5401805e0 with identifier: GE15008
2026-03-29 10:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eef62774-b546-5532-8e6c-22f5401805e0 with identifier: GE15008 to the API
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:39:40Z',
 'fuel_type': 'petrol',
 'id': 'eef62774-b546-5532-8e6c-22f5401805e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE15008',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 62240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-21',
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.2 PureTech Seduction',
 'transmission': 'manual',
 'trim': 'Seduction',
 'year': 2016}
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE15008%27 HTTP/1.1" 200 None
2026-03-29 10:35:18 [auto1.de] INFO: Saving data for GE15008: {'auction_closing_time': 1774885180.0, 'created_time': 1773427925.471678, 'last_price_update_time': 1774780518.855756}
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE15008') HTTP/1.1" 204 0
2026-03-29 10:35:18 [auto1.de] INFO: Found listing with ID: SA16616
2026-03-29 10:35:18 [auto1.de] INFO: Found listing with ID: FH74417
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH74417%27 HTTP/1.1" 200 None
2026-03-29 10:35:18 [auto1.de] INFO: Scrape type for FH74417: 2
2026-03-29 10:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89e9e7b3-0326-5acb-a298-430d509a6015 with identifier: FH74417
2026-03-29 10:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89e9e7b3-0326-5acb-a298-430d509a6015 with scrape type 2
2026-03-29 10:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89e9e7b3-0326-5acb-a298-430d509a6015 with scrape type 2
2026-03-29 10:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89e9e7b3-0326-5acb-a298-430d509a6015, identifier: FH74417
2026-03-29 10:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89e9e7b3-0326-5acb-a298-430d509a6015 with identifier: FH74417
2026-03-29 10:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 10:35:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-29 10:35:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 10:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89e9e7b3-0326-5acb-a298-430d509a6015 with identifier: FH74417
2026-03-29 10:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89e9e7b3-0326-5acb-a298-430d509a6015 with identifier: FH74417 to the API
2026-03-29 10:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:25:19Z',
 'fuel_type': 'petrol',
 'id': '89e9e7b3-0326-5acb-a298-430d509a6015',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH74417',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Agila',
 'odometer': 101214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-06',
 'seller_name': None,
 'title': 'Opel Agila 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2006}
2026-03-29 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH74417%27 HTTP/1.1" 200 None
2026-03-29 10:35:19 [auto1.de] INFO: Saving data for FH74417: {'auction_closing_time': 1774884319.0, 'created_time': 1773427108.757869, 'last_price_update_time': 1774780519.482369}
2026-03-29 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH74417') HTTP/1.1" 204 0
2026-03-29 10:35:19 [auto1.de] INFO: Found listing with ID: RG72110
2026-03-29 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG72110%27 HTTP/1.1" 200 None
2026-03-29 10:35:19 [auto1.de] INFO: Scrape type for RG72110: 2
2026-03-29 10:35:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0877b22f-dbfc-5a33-ac77-b84c59a694c2 with identifier: RG72110
2026-03-29 10:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0877b22f-dbfc-5a33-ac77-b84c59a694c2 with scrape type 2
2026-03-29 10:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0877b22f-dbfc-5a33-ac77-b84c59a694c2 with scrape type 2
2026-03-29 10:35:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0877b22f-dbfc-5a33-ac77-b84c59a694c2, identifier: RG72110
2026-03-29 10:35:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0877b22f-dbfc-5a33-ac77-b84c59a694c2 with identifier: RG72110
2026-03-29 10:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 10:35:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-29 10:35:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 10:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 10:35:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0877b22f-dbfc-5a33-ac77-b84c59a694c2 with identifier: RG72110
2026-03-29 10:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0877b22f-dbfc-5a33-ac77-b84c59a694c2 with identifier: RG72110 to the API
2026-03-29 10:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:04:54Z',
 'fuel_type': 'petrol',
 'id': '0877b22f-dbfc-5a33-ac77-b84c59a694c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG72110',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 114028,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-10',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TFSI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2016}
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG72110%27 HTTP/1.1" 200 None
2026-03-29 10:35:20 [auto1.de] INFO: Saving data for RG72110: {'auction_closing_time': 1774883094.0, 'created_time': 1774551744.491053, 'last_price_update_time': 1774780520.048592}
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG72110') HTTP/1.1" 204 0
2026-03-29 10:35:20 [auto1.de] INFO: Found listing with ID: HN36676
2026-03-29 10:35:20 [auto1.de] INFO: Found listing with ID: BX89684
2026-03-29 10:35:20 [auto1.de] INFO: Found listing with ID: AB70277
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB70277%27 HTTP/1.1" 200 None
2026-03-29 10:35:20 [auto1.de] INFO: Scrape type for AB70277: 1
2026-03-29 10:35:20 [auto1.de] INFO: Found listing with ID: GN07930
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN07930%27 HTTP/1.1" 200 None
2026-03-29 10:35:20 [auto1.de] INFO: Scrape type for GN07930: 2
2026-03-29 10:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3016e719-8cb7-5108-ae10-53677ece2edd with identifier: GN07930
2026-03-29 10:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3016e719-8cb7-5108-ae10-53677ece2edd with scrape type 2
2026-03-29 10:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3016e719-8cb7-5108-ae10-53677ece2edd with scrape type 2
2026-03-29 10:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3016e719-8cb7-5108-ae10-53677ece2edd, identifier: GN07930
2026-03-29 10:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3016e719-8cb7-5108-ae10-53677ece2edd with identifier: GN07930
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-29 10:35:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 10:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3016e719-8cb7-5108-ae10-53677ece2edd with identifier: GN07930
2026-03-29 10:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3016e719-8cb7-5108-ae10-53677ece2edd with identifier: GN07930 to the API
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 238,
 'expiration_date': '2026-03-30T15:57:47Z',
 'fuel_type': 'diesel',
 'id': '3016e719-8cb7-5108-ae10-53677ece2edd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN07930',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Edge',
 'odometer': 91787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-06',
 'seller_name': None,
 'title': 'Ford Edge 2.0 TDCi EcoBlue ST-Line 4x4',
 'transmission': 'automatic',
 'trim': 'ST-Line 4x4',
 'year': 2019}
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN07930%27 HTTP/1.1" 200 None
2026-03-29 10:35:20 [auto1.de] INFO: Saving data for GN07930: {'auction_closing_time': 1774886267.0, 'created_time': 1773945979.492339, 'last_price_update_time': 1774780520.676499}
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GN07930') HTTP/1.1" 204 0
2026-03-29 10:35:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:20 [auto1.de] INFO: Found listing with ID: PJ34146
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ34146%27 HTTP/1.1" 200 None
2026-03-29 10:35:20 [auto1.de] INFO: Scrape type for PJ34146: 2
2026-03-29 10:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a28deb8-8b6a-5aae-ba24-fce951aaaecd with identifier: PJ34146
2026-03-29 10:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a28deb8-8b6a-5aae-ba24-fce951aaaecd with scrape type 2
2026-03-29 10:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a28deb8-8b6a-5aae-ba24-fce951aaaecd with scrape type 2
2026-03-29 10:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a28deb8-8b6a-5aae-ba24-fce951aaaecd, identifier: PJ34146
2026-03-29 10:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a28deb8-8b6a-5aae-ba24-fce951aaaecd with identifier: PJ34146
2026-03-29 10:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a28deb8-8b6a-5aae-ba24-fce951aaaecd with identifier: PJ34146
2026-03-29 10:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a28deb8-8b6a-5aae-ba24-fce951aaaecd with identifier: PJ34146 to the API
2026-03-29 10:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:16:16Z',
 'fuel_type': 'diesel',
 'id': '7a28deb8-8b6a-5aae-ba24-fce951aaaecd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ34146',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 146352,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-23',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2012}
2026-03-29 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ34146%27 HTTP/1.1" 200 None
2026-03-29 10:35:21 [auto1.de] INFO: Saving data for PJ34146: {'auction_closing_time': 1774883776.0, 'created_time': 1774637597.74455, 'last_price_update_time': 1774780521.227528}
2026-03-29 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ34146') HTTP/1.1" 204 0
2026-03-29 10:35:21 [auto1.de] INFO: Found listing with ID: HM22337
2026-03-29 10:35:21 [auto1.de] INFO: Found listing with ID: SU78317
2026-03-29 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU78317%27 HTTP/1.1" 200 None
2026-03-29 10:35:21 [auto1.de] INFO: Scrape type for SU78317: 2
2026-03-29 10:35:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37425829-4c42-59fd-a6b6-3843e707f888 with identifier: SU78317
2026-03-29 10:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37425829-4c42-59fd-a6b6-3843e707f888 with scrape type 2
2026-03-29 10:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37425829-4c42-59fd-a6b6-3843e707f888 with scrape type 2
2026-03-29 10:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 37425829-4c42-59fd-a6b6-3843e707f888, identifier: SU78317
2026-03-29 10:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 37425829-4c42-59fd-a6b6-3843e707f888 with identifier: SU78317
2026-03-29 10:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 37425829-4c42-59fd-a6b6-3843e707f888 with identifier: SU78317
2026-03-29 10:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 37425829-4c42-59fd-a6b6-3843e707f888 with identifier: SU78317 to the API
2026-03-29 10:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:11:12Z',
 'fuel_type': 'petrol',
 'id': '37425829-4c42-59fd-a6b6-3843e707f888',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU78317',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 215017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-10-11',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 Kompressor T Classic',
 'transmission': 'automatic',
 'trim': 'T Classic',
 'year': 2005}
2026-03-29 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU78317%27 HTTP/1.1" 200 None
2026-03-29 10:35:21 [auto1.de] INFO: Saving data for SU78317: {'auction_closing_time': 1774883472.0, 'created_time': 1773427069.121503, 'last_price_update_time': 1774780521.73657}
2026-03-29 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SU78317') HTTP/1.1" 204 0
2026-03-29 10:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:21 [auto1.de] INFO: Found listing with ID: PY59919
2026-03-29 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY59919%27 HTTP/1.1" 200 None
2026-03-29 10:35:21 [auto1.de] INFO: Scrape type for PY59919: 2
2026-03-29 10:35:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75ba8a96-e98b-5632-88bf-e3c1cc1dc068 with identifier: PY59919
2026-03-29 10:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75ba8a96-e98b-5632-88bf-e3c1cc1dc068 with scrape type 2
2026-03-29 10:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75ba8a96-e98b-5632-88bf-e3c1cc1dc068 with scrape type 2
2026-03-29 10:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75ba8a96-e98b-5632-88bf-e3c1cc1dc068, identifier: PY59919
2026-03-29 10:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75ba8a96-e98b-5632-88bf-e3c1cc1dc068 with identifier: PY59919
2026-03-29 10:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 10:35:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-29 10:35:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 10:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75ba8a96-e98b-5632-88bf-e3c1cc1dc068 with identifier: PY59919
2026-03-29 10:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75ba8a96-e98b-5632-88bf-e3c1cc1dc068 with identifier: PY59919 to the API
2026-03-29 10:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:26:27Z',
 'fuel_type': 'diesel',
 'id': '75ba8a96-e98b-5632-88bf-e3c1cc1dc068',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY59919',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 405941,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-01',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 CDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2018}
2026-03-29 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY59919%27 HTTP/1.1" 200 None
2026-03-29 10:35:22 [auto1.de] INFO: Saving data for PY59919: {'auction_closing_time': 1774884387.0, 'created_time': 1773427395.861488, 'last_price_update_time': 1774780522.536417}
2026-03-29 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY59919') HTTP/1.1" 204 0
2026-03-29 10:35:22 [auto1.de] INFO: Found listing with ID: MP03054
2026-03-29 10:35:22 [auto1.de] INFO: Found listing with ID: PF20752
2026-03-29 10:35:22 [auto1.de] INFO: Found listing with ID: JM25076
2026-03-29 10:35:22 [auto1.de] INFO: Found listing with ID: BE10482
2026-03-29 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE10482%27 HTTP/1.1" 200 None
2026-03-29 10:35:22 [auto1.de] INFO: Scrape type for BE10482: 2
2026-03-29 10:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 525eb71d-9630-5d4d-bb37-9e6b41754f7a with identifier: BE10482
2026-03-29 10:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 525eb71d-9630-5d4d-bb37-9e6b41754f7a with scrape type 2
2026-03-29 10:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 525eb71d-9630-5d4d-bb37-9e6b41754f7a with scrape type 2
2026-03-29 10:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 525eb71d-9630-5d4d-bb37-9e6b41754f7a, identifier: BE10482
2026-03-29 10:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 525eb71d-9630-5d4d-bb37-9e6b41754f7a with identifier: BE10482
2026-03-29 10:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 525eb71d-9630-5d4d-bb37-9e6b41754f7a with identifier: BE10482
2026-03-29 10:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 525eb71d-9630-5d4d-bb37-9e6b41754f7a with identifier: BE10482 to the API
2026-03-29 10:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 55,
 'expiration_date': '2026-03-30T15:05:22Z',
 'fuel_type': 'petrol',
 'id': '525eb71d-9630-5d4d-bb37-9e6b41754f7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE10482',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Seicento',
 'odometer': 90751,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-11-30',
 'seller_name': None,
 'title': 'Fiat Seicento 1.1 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2004}
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE10482%27 HTTP/1.1" 200 None
2026-03-29 10:35:23 [auto1.de] INFO: Saving data for BE10482: {'auction_closing_time': 1774883122.0, 'created_time': 1774378553.355722, 'last_price_update_time': 1774780523.053638}
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE10482') HTTP/1.1" 204 0
2026-03-29 10:35:23 [auto1.de] INFO: Channel: 24h | Page: 1 | totalHits: 6726 | hits on page: 40
2026-03-29 10:35:23 [auto1.de] INFO: Found listing with ID: HD80802
2026-03-29 10:35:23 [auto1.de] INFO: Found listing with ID: CR70620
2026-03-29 10:35:23 [auto1.de] INFO: Found listing with ID: DY40129
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY40129%27 HTTP/1.1" 200 None
2026-03-29 10:35:23 [auto1.de] INFO: Scrape type for DY40129: 2
2026-03-29 10:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1359aa8a-0d75-5924-8f59-ed5b9ede1629 with identifier: DY40129
2026-03-29 10:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1359aa8a-0d75-5924-8f59-ed5b9ede1629 with scrape type 2
2026-03-29 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1359aa8a-0d75-5924-8f59-ed5b9ede1629 with scrape type 2
2026-03-29 10:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1359aa8a-0d75-5924-8f59-ed5b9ede1629, identifier: DY40129
2026-03-29 10:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1359aa8a-0d75-5924-8f59-ed5b9ede1629 with identifier: DY40129
2026-03-29 10:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1359aa8a-0d75-5924-8f59-ed5b9ede1629 with identifier: DY40129
2026-03-29 10:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1359aa8a-0d75-5924-8f59-ed5b9ede1629 with identifier: DY40129 to the API
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-30T15:53:21Z',
 'fuel_type': 'petrol',
 'id': '1359aa8a-0d75-5924-8f59-ed5b9ede1629',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY40129',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 156492,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-29',
 'seller_name': None,
 'title': 'Peugeot 207 1.4 Filou',
 'transmission': 'manual',
 'trim': 'Filou',
 'year': 2009}
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY40129%27 HTTP/1.1" 200 None
2026-03-29 10:35:23 [auto1.de] INFO: Saving data for DY40129: {'auction_closing_time': 1774886001.0, 'created_time': 1774550960.024995, 'last_price_update_time': 1774780523.552186}
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DY40129') HTTP/1.1" 204 0
2026-03-29 10:35:23 [auto1.de] INFO: Found listing with ID: PY88253
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY88253%27 HTTP/1.1" 200 None
2026-03-29 10:35:23 [auto1.de] INFO: Scrape type for PY88253: 0
2026-03-29 10:35:23 [auto1.de] INFO: Found listing with ID: GE15008
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE15008%27 HTTP/1.1" 200 None
2026-03-29 10:35:23 [auto1.de] INFO: Scrape type for GE15008: 0
2026-03-29 10:35:23 [auto1.de] INFO: Found listing with ID: SA16616
2026-03-29 10:35:23 [auto1.de] INFO: Found listing with ID: FH74417
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH74417%27 HTTP/1.1" 200 None
2026-03-29 10:35:23 [auto1.de] INFO: Scrape type for FH74417: 0
2026-03-29 10:35:23 [auto1.de] INFO: Found listing with ID: RG72110
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG72110%27 HTTP/1.1" 200 None
2026-03-29 10:35:23 [auto1.de] INFO: Scrape type for RG72110: 0
2026-03-29 10:35:23 [auto1.de] INFO: Found listing with ID: HN36676
2026-03-29 10:35:23 [auto1.de] INFO: Found listing with ID: BX89684
2026-03-29 10:35:23 [auto1.de] INFO: Found listing with ID: AB70277
2026-03-29 10:35:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:23 [auto1.de] INFO: Found listing with ID: BV77129
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV77129%27 HTTP/1.1" 200 None
2026-03-29 10:35:23 [auto1.de] INFO: Scrape type for BV77129: 2
2026-03-29 10:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62f99909-de8b-5553-94d5-2011cfc2b9e7 with identifier: BV77129
2026-03-29 10:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62f99909-de8b-5553-94d5-2011cfc2b9e7 with scrape type 2
2026-03-29 10:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62f99909-de8b-5553-94d5-2011cfc2b9e7 with scrape type 2
2026-03-29 10:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62f99909-de8b-5553-94d5-2011cfc2b9e7, identifier: BV77129
2026-03-29 10:35:23 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/AB70277/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-29 10:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62f99909-de8b-5553-94d5-2011cfc2b9e7 with identifier: BV77129
2026-03-29 10:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62f99909-de8b-5553-94d5-2011cfc2b9e7 with identifier: BV77129
2026-03-29 10:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62f99909-de8b-5553-94d5-2011cfc2b9e7 with identifier: BV77129 to the API
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:29:00Z',
 'fuel_type': 'petrol',
 'id': '62f99909-de8b-5553-94d5-2011cfc2b9e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV77129',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 244815,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-11',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 TSI United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2008}
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV77129%27 HTTP/1.1" 200 None
2026-03-29 10:35:24 [auto1.de] INFO: Saving data for BV77129: {'auction_closing_time': 1774884540.0, 'created_time': 1773307986.011677, 'last_price_update_time': 1774780524.110688}
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV77129') HTTP/1.1" 204 0
2026-03-29 10:35:24 [auto1.de] INFO: Found listing with ID: GN07930
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN07930%27 HTTP/1.1" 200 None
2026-03-29 10:35:24 [auto1.de] INFO: Scrape type for GN07930: 0
2026-03-29 10:35:24 [auto1.de] INFO: Found listing with ID: PJ34146
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ34146%27 HTTP/1.1" 200 None
2026-03-29 10:35:24 [auto1.de] INFO: Scrape type for PJ34146: 0
2026-03-29 10:35:24 [auto1.de] INFO: Found listing with ID: HM22337
2026-03-29 10:35:24 [auto1.de] INFO: Found listing with ID: SU78317
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU78317%27 HTTP/1.1" 200 None
2026-03-29 10:35:24 [auto1.de] INFO: Scrape type for SU78317: 0
2026-03-29 10:35:24 [auto1.de] INFO: Found listing with ID: PY59919
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY59919%27 HTTP/1.1" 200 None
2026-03-29 10:35:24 [auto1.de] INFO: Scrape type for PY59919: 0
2026-03-29 10:35:24 [auto1.de] INFO: Found listing with ID: MP03054
2026-03-29 10:35:24 [auto1.de] INFO: Found listing with ID: PF20752
2026-03-29 10:35:24 [auto1.de] INFO: Found listing with ID: JM25076
2026-03-29 10:35:24 [auto1.de] INFO: Found listing with ID: BE10482
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE10482%27 HTTP/1.1" 200 None
2026-03-29 10:35:24 [auto1.de] INFO: Scrape type for BE10482: 0
2026-03-29 10:35:24 [auto1.de] INFO: Found listing with ID: HD80802
2026-03-29 10:35:24 [auto1.de] INFO: Found listing with ID: CR70620
2026-03-29 10:35:24 [auto1.de] INFO: Found listing with ID: DY40129
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY40129%27 HTTP/1.1" 200 None
2026-03-29 10:35:24 [auto1.de] INFO: Scrape type for DY40129: 0
2026-03-29 10:35:24 [auto1.de] INFO: Found listing with ID: BV77129
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV77129%27 HTTP/1.1" 200 None
2026-03-29 10:35:24 [auto1.de] INFO: Scrape type for BV77129: 0
2026-03-29 10:35:24 [auto1.de] INFO: Found listing with ID: PX43483
2026-03-29 10:35:24 [auto1.de] INFO: Found listing with ID: FY87536
2026-03-29 10:35:24 [auto1.de] INFO: Found listing with ID: YH32466
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH32466%27 HTTP/1.1" 200 None
2026-03-29 10:35:24 [auto1.de] INFO: Scrape type for YH32466: 2
2026-03-29 10:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c37d971-0f8c-55e9-98e0-025af895a389 with identifier: YH32466
2026-03-29 10:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c37d971-0f8c-55e9-98e0-025af895a389 with scrape type 2
2026-03-29 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c37d971-0f8c-55e9-98e0-025af895a389 with scrape type 2
2026-03-29 10:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c37d971-0f8c-55e9-98e0-025af895a389, identifier: YH32466
2026-03-29 10:35:24 [auto1.de] INFO: Found listing with ID: PX43483
2026-03-29 10:35:24 [auto1.de] INFO: Found listing with ID: FY87536
2026-03-29 10:35:24 [auto1.de] INFO: Found listing with ID: YH32466
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH32466%27 HTTP/1.1" 200 None
2026-03-29 10:35:24 [auto1.de] INFO: Scrape type for YH32466: 2
2026-03-29 10:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c37d971-0f8c-55e9-98e0-025af895a389 with scrape type 2
2026-03-29 10:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c37d971-0f8c-55e9-98e0-025af895a389 with scrape type 2
2026-03-29 10:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c37d971-0f8c-55e9-98e0-025af895a389, identifier: YH32466
2026-03-29 10:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c37d971-0f8c-55e9-98e0-025af895a389 with identifier: YH32466
2026-03-29 10:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c37d971-0f8c-55e9-98e0-025af895a389 with identifier: YH32466
2026-03-29 10:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c37d971-0f8c-55e9-98e0-025af895a389 with identifier: YH32466 to the API
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:08:33Z',
 'fuel_type': 'petrol',
 'id': '4c37d971-0f8c-55e9-98e0-025af895a389',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH32466',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 203061,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-12-20',
 'seller_name': None,
 'title': 'BMW 5er 530i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2006}
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH32466%27 HTTP/1.1" 200 None
2026-03-29 10:35:25 [auto1.de] INFO: Saving data for YH32466: {'auction_closing_time': 1774883313.0, 'created_time': 1774637387.970716, 'last_price_update_time': 1774780525.009523}
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH32466') HTTP/1.1" 204 0
2026-03-29 10:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c37d971-0f8c-55e9-98e0-025af895a389 with identifier: YH32466
2026-03-29 10:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c37d971-0f8c-55e9-98e0-025af895a389 with identifier: YH32466
2026-03-29 10:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c37d971-0f8c-55e9-98e0-025af895a389 with identifier: YH32466 to the API
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:08:33Z',
 'fuel_type': 'petrol',
 'id': '4c37d971-0f8c-55e9-98e0-025af895a389',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH32466',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 203061,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-12-20',
 'seller_name': None,
 'title': 'BMW 5er 530i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2006}
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH32466%27 HTTP/1.1" 200 None
2026-03-29 10:35:25 [auto1.de] INFO: Saving data for YH32466: {'auction_closing_time': 1774883313.0, 'created_time': 1774637387.970716, 'last_price_update_time': 1774780525.394997}
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH32466') HTTP/1.1" 204 0
2026-03-29 10:35:25 [auto1.de] INFO: Found listing with ID: ZW96632
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW96632%27 HTTP/1.1" 200 None
2026-03-29 10:35:25 [auto1.de] INFO: Scrape type for ZW96632: 2
2026-03-29 10:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dcad5ed-5aff-582a-bde0-e25947a26f78 with identifier: ZW96632
2026-03-29 10:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dcad5ed-5aff-582a-bde0-e25947a26f78 with scrape type 2
2026-03-29 10:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0dcad5ed-5aff-582a-bde0-e25947a26f78 with scrape type 2
2026-03-29 10:35:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0dcad5ed-5aff-582a-bde0-e25947a26f78, identifier: ZW96632
2026-03-29 10:35:25 [auto1.de] INFO: Found listing with ID: ZW96632
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW96632%27 HTTP/1.1" 200 None
2026-03-29 10:35:25 [auto1.de] INFO: Scrape type for ZW96632: 2
2026-03-29 10:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dcad5ed-5aff-582a-bde0-e25947a26f78 with scrape type 2
2026-03-29 10:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0dcad5ed-5aff-582a-bde0-e25947a26f78 with scrape type 2
2026-03-29 10:35:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0dcad5ed-5aff-582a-bde0-e25947a26f78, identifier: ZW96632
2026-03-29 10:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0dcad5ed-5aff-582a-bde0-e25947a26f78 with identifier: ZW96632
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-29 10:35:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 10:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0dcad5ed-5aff-582a-bde0-e25947a26f78 with identifier: ZW96632
2026-03-29 10:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0dcad5ed-5aff-582a-bde0-e25947a26f78 with identifier: ZW96632 to the API
2026-03-29 10:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:02:08Z',
 'fuel_type': 'petrol',
 'id': '0dcad5ed-5aff-582a-bde0-e25947a26f78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW96632',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 196939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1991-08-14',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.8',
 'transmission': 'manual',
 'trim': '',
 'year': 1991}
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW96632%27 HTTP/1.1" 200 None
2026-03-29 10:35:26 [auto1.de] INFO: Saving data for ZW96632: {'auction_closing_time': 1774882928.0, 'created_time': 1774637454.154318, 'last_price_update_time': 1774780526.217666}
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW96632') HTTP/1.1" 204 0
2026-03-29 10:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AB70277/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0dcad5ed-5aff-582a-bde0-e25947a26f78 with identifier: ZW96632
2026-03-29 10:35:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0dcad5ed-5aff-582a-bde0-e25947a26f78 with identifier: ZW96632
2026-03-29 10:35:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0dcad5ed-5aff-582a-bde0-e25947a26f78 with identifier: ZW96632 to the API
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:02:08Z',
 'fuel_type': 'petrol',
 'id': '0dcad5ed-5aff-582a-bde0-e25947a26f78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW96632',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 196939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1991-08-14',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.8',
 'transmission': 'manual',
 'trim': '',
 'year': 1991}
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW96632%27 HTTP/1.1" 200 None
2026-03-29 10:35:26 [auto1.de] INFO: Saving data for ZW96632: {'auction_closing_time': 1774882928.0, 'created_time': 1774637454.154318, 'last_price_update_time': 1774780526.536055}
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW96632') HTTP/1.1" 204 0
2026-03-29 10:35:26 [auto1.de] INFO: Found listing with ID: NW88180
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW88180%27 HTTP/1.1" 200 None
2026-03-29 10:35:26 [auto1.de] INFO: Scrape type for NW88180: 2
2026-03-29 10:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9aa08549-c2cd-5f81-9f18-18137acf81b0 with identifier: NW88180
2026-03-29 10:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9aa08549-c2cd-5f81-9f18-18137acf81b0 with scrape type 2
2026-03-29 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9aa08549-c2cd-5f81-9f18-18137acf81b0 with scrape type 2
2026-03-29 10:35:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9aa08549-c2cd-5f81-9f18-18137acf81b0, identifier: NW88180
2026-03-29 10:35:26 [auto1.de] INFO: Found listing with ID: NW88180
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW88180%27 HTTP/1.1" 200 None
2026-03-29 10:35:26 [auto1.de] INFO: Scrape type for NW88180: 2
2026-03-29 10:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9aa08549-c2cd-5f81-9f18-18137acf81b0 with scrape type 2
2026-03-29 10:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9aa08549-c2cd-5f81-9f18-18137acf81b0 with scrape type 2
2026-03-29 10:35:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9aa08549-c2cd-5f81-9f18-18137acf81b0, identifier: NW88180
2026-03-29 10:35:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9aa08549-c2cd-5f81-9f18-18137acf81b0 with identifier: NW88180
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-29 10:35:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 10:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 10:35:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9aa08549-c2cd-5f81-9f18-18137acf81b0 with identifier: NW88180
2026-03-29 10:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9aa08549-c2cd-5f81-9f18-18137acf81b0 with identifier: NW88180 to the API
2026-03-29 10:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:57:55Z',
 'fuel_type': 'petrol',
 'id': '9aa08549-c2cd-5f81-9f18-18137acf81b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW88180',
 'listing': 'auction',
 'make': 'Dodge',
 'model': 'Caliber',
 'odometer': 212137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-12-18',
 'seller_name': None,
 'title': 'Dodge Caliber 2.0 SXT',
 'transmission': 'automatic',
 'trim': 'SXT',
 'year': 2007}
2026-03-29 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW88180%27 HTTP/1.1" 200 None
2026-03-29 10:35:27 [auto1.de] INFO: Saving data for NW88180: {'auction_closing_time': 1774886275.0, 'created_time': 1773861442.905958, 'last_price_update_time': 1774780527.288825}
2026-03-29 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NW88180') HTTP/1.1" 204 0
2026-03-29 10:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9aa08549-c2cd-5f81-9f18-18137acf81b0 with identifier: NW88180
2026-03-29 10:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9aa08549-c2cd-5f81-9f18-18137acf81b0 with identifier: NW88180
2026-03-29 10:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9aa08549-c2cd-5f81-9f18-18137acf81b0 with identifier: NW88180 to the API
2026-03-29 10:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:57:55Z',
 'fuel_type': 'petrol',
 'id': '9aa08549-c2cd-5f81-9f18-18137acf81b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW88180',
 'listing': 'auction',
 'make': 'Dodge',
 'model': 'Caliber',
 'odometer': 212137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-12-18',
 'seller_name': None,
 'title': 'Dodge Caliber 2.0 SXT',
 'transmission': 'automatic',
 'trim': 'SXT',
 'year': 2007}
2026-03-29 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW88180%27 HTTP/1.1" 200 None
2026-03-29 10:35:27 [auto1.de] INFO: Saving data for NW88180: {'auction_closing_time': 1774886275.0, 'created_time': 1773861442.905958, 'last_price_update_time': 1774780527.615372}
2026-03-29 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NW88180') HTTP/1.1" 204 0
2026-03-29 10:35:27 [auto1.de] INFO: Found listing with ID: KS38701
2026-03-29 10:35:27 [auto1.de] INFO: Found listing with ID: ZY10708
2026-03-29 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY10708%27 HTTP/1.1" 200 None
2026-03-29 10:35:27 [auto1.de] INFO: Scrape type for ZY10708: 2
2026-03-29 10:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a54fcc7-6ab6-5592-b8b5-67a35b373d89 with identifier: ZY10708
2026-03-29 10:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a54fcc7-6ab6-5592-b8b5-67a35b373d89 with scrape type 2
2026-03-29 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a54fcc7-6ab6-5592-b8b5-67a35b373d89 with scrape type 2
2026-03-29 10:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a54fcc7-6ab6-5592-b8b5-67a35b373d89, identifier: ZY10708
2026-03-29 10:35:27 [auto1.de] INFO: Found listing with ID: KS38701
2026-03-29 10:35:27 [auto1.de] INFO: Found listing with ID: ZY10708
2026-03-29 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY10708%27 HTTP/1.1" 200 None
2026-03-29 10:35:27 [auto1.de] INFO: Scrape type for ZY10708: 2
2026-03-29 10:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a54fcc7-6ab6-5592-b8b5-67a35b373d89 with scrape type 2
2026-03-29 10:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a54fcc7-6ab6-5592-b8b5-67a35b373d89 with scrape type 2
2026-03-29 10:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a54fcc7-6ab6-5592-b8b5-67a35b373d89, identifier: ZY10708
2026-03-29 10:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a54fcc7-6ab6-5592-b8b5-67a35b373d89 with identifier: ZY10708
2026-03-29 10:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a54fcc7-6ab6-5592-b8b5-67a35b373d89 with identifier: ZY10708
2026-03-29 10:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a54fcc7-6ab6-5592-b8b5-67a35b373d89 with identifier: ZY10708 to the API
2026-03-29 10:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:00:52Z',
 'fuel_type': 'diesel',
 'id': '4a54fcc7-6ab6-5592-b8b5-67a35b373d89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY10708',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 200063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-11',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Attraction',
 'transmission': 'automatic',
 'trim': 'Attraction',
 'year': 2009}
2026-03-29 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY10708%27 HTTP/1.1" 200 None
2026-03-29 10:35:28 [auto1.de] INFO: Saving data for ZY10708: {'auction_closing_time': 1774882852.0, 'created_time': 1773554115.392072, 'last_price_update_time': 1774780528.217511}
2026-03-29 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY10708') HTTP/1.1" 204 0
2026-03-29 10:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a54fcc7-6ab6-5592-b8b5-67a35b373d89 with identifier: ZY10708
2026-03-29 10:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a54fcc7-6ab6-5592-b8b5-67a35b373d89 with identifier: ZY10708
2026-03-29 10:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a54fcc7-6ab6-5592-b8b5-67a35b373d89 with identifier: ZY10708 to the API
2026-03-29 10:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:00:52Z',
 'fuel_type': 'diesel',
 'id': '4a54fcc7-6ab6-5592-b8b5-67a35b373d89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY10708',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 200063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-11',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Attraction',
 'transmission': 'automatic',
 'trim': 'Attraction',
 'year': 2009}
2026-03-29 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY10708%27 HTTP/1.1" 200 None
2026-03-29 10:35:28 [auto1.de] INFO: Saving data for ZY10708: {'auction_closing_time': 1774882852.0, 'created_time': 1773554115.392072, 'last_price_update_time': 1774780528.4962}
2026-03-29 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY10708') HTTP/1.1" 204 0
2026-03-29 10:35:28 [auto1.de] INFO: Found listing with ID: HC26014
2026-03-29 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC26014%27 HTTP/1.1" 200 None
2026-03-29 10:35:28 [auto1.de] INFO: Scrape type for HC26014: 2
2026-03-29 10:35:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a152687b-cb8f-54d8-8aaa-db4c00b5d621 with identifier: HC26014
2026-03-29 10:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a152687b-cb8f-54d8-8aaa-db4c00b5d621 with scrape type 2
2026-03-29 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a152687b-cb8f-54d8-8aaa-db4c00b5d621 with scrape type 2
2026-03-29 10:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a152687b-cb8f-54d8-8aaa-db4c00b5d621, identifier: HC26014
2026-03-29 10:35:28 [auto1.de] INFO: Found listing with ID: HC26014
2026-03-29 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC26014%27 HTTP/1.1" 200 None
2026-03-29 10:35:28 [auto1.de] INFO: Scrape type for HC26014: 2
2026-03-29 10:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a152687b-cb8f-54d8-8aaa-db4c00b5d621 with scrape type 2
2026-03-29 10:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a152687b-cb8f-54d8-8aaa-db4c00b5d621 with scrape type 2
2026-03-29 10:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a152687b-cb8f-54d8-8aaa-db4c00b5d621, identifier: HC26014
2026-03-29 10:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a152687b-cb8f-54d8-8aaa-db4c00b5d621 with identifier: HC26014
2026-03-29 10:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a152687b-cb8f-54d8-8aaa-db4c00b5d621 with identifier: HC26014
2026-03-29 10:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a152687b-cb8f-54d8-8aaa-db4c00b5d621 with identifier: HC26014 to the API
2026-03-29 10:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:53:27Z',
 'fuel_type': 'petrol',
 'id': 'a152687b-cb8f-54d8-8aaa-db4c00b5d621',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC26014',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 158699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-17',
 'seller_name': None,
 'title': 'Opel Meriva 1.6 Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2008}
2026-03-29 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC26014%27 HTTP/1.1" 200 None
2026-03-29 10:35:29 [auto1.de] INFO: Saving data for HC26014: {'auction_closing_time': 1774886007.0, 'created_time': 1774550875.716594, 'last_price_update_time': 1774780529.075493}
2026-03-29 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HC26014') HTTP/1.1" 204 0
2026-03-29 10:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a152687b-cb8f-54d8-8aaa-db4c00b5d621 with identifier: HC26014
2026-03-29 10:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a152687b-cb8f-54d8-8aaa-db4c00b5d621 with identifier: HC26014
2026-03-29 10:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a152687b-cb8f-54d8-8aaa-db4c00b5d621 with identifier: HC26014 to the API
2026-03-29 10:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:53:27Z',
 'fuel_type': 'petrol',
 'id': 'a152687b-cb8f-54d8-8aaa-db4c00b5d621',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC26014',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 158699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-17',
 'seller_name': None,
 'title': 'Opel Meriva 1.6 Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2008}
2026-03-29 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC26014%27 HTTP/1.1" 200 None
2026-03-29 10:35:29 [auto1.de] INFO: Saving data for HC26014: {'auction_closing_time': 1774886007.0, 'created_time': 1774550875.716594, 'last_price_update_time': 1774780529.405257}
2026-03-29 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HC26014') HTTP/1.1" 204 0
2026-03-29 10:35:29 [auto1.de] INFO: Found listing with ID: LN64409
2026-03-29 10:35:29 [auto1.de] INFO: Found listing with ID: BB56040
2026-03-29 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB56040%27 HTTP/1.1" 200 None
2026-03-29 10:35:29 [auto1.de] INFO: Scrape type for BB56040: 2
2026-03-29 10:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9a534c9-34d5-59fb-bf33-9dea223ec2d1 with identifier: BB56040
2026-03-29 10:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9a534c9-34d5-59fb-bf33-9dea223ec2d1 with scrape type 2
2026-03-29 10:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9a534c9-34d5-59fb-bf33-9dea223ec2d1 with scrape type 2
2026-03-29 10:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9a534c9-34d5-59fb-bf33-9dea223ec2d1, identifier: BB56040
2026-03-29 10:35:29 [auto1.de] INFO: Found listing with ID: LN64409
2026-03-29 10:35:29 [auto1.de] INFO: Found listing with ID: BB56040
2026-03-29 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB56040%27 HTTP/1.1" 200 None
2026-03-29 10:35:29 [auto1.de] INFO: Scrape type for BB56040: 2
2026-03-29 10:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9a534c9-34d5-59fb-bf33-9dea223ec2d1 with scrape type 2
2026-03-29 10:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9a534c9-34d5-59fb-bf33-9dea223ec2d1 with scrape type 2
2026-03-29 10:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9a534c9-34d5-59fb-bf33-9dea223ec2d1, identifier: BB56040
2026-03-29 10:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9a534c9-34d5-59fb-bf33-9dea223ec2d1 with identifier: BB56040
2026-03-29 10:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9a534c9-34d5-59fb-bf33-9dea223ec2d1 with identifier: BB56040
2026-03-29 10:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9a534c9-34d5-59fb-bf33-9dea223ec2d1 with identifier: BB56040 to the API
2026-03-29 10:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:20:47Z',
 'fuel_type': 'diesel',
 'id': 'b9a534c9-34d5-59fb-bf33-9dea223ec2d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB56040',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 291837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-04-30',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.9 TDI Goal',
 'transmission': 'manual',
 'trim': 'Goal',
 'year': 2006}
2026-03-29 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB56040%27 HTTP/1.1" 200 None
2026-03-29 10:35:30 [auto1.de] INFO: Saving data for BB56040: {'auction_closing_time': 1774884047.0, 'created_time': 1773383028.801324, 'last_price_update_time': 1774780530.016822}
2026-03-29 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB56040') HTTP/1.1" 204 0
2026-03-29 10:35:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9a534c9-34d5-59fb-bf33-9dea223ec2d1 with identifier: BB56040
2026-03-29 10:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9a534c9-34d5-59fb-bf33-9dea223ec2d1 with identifier: BB56040
2026-03-29 10:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9a534c9-34d5-59fb-bf33-9dea223ec2d1 with identifier: BB56040 to the API
2026-03-29 10:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:20:47Z',
 'fuel_type': 'diesel',
 'id': 'b9a534c9-34d5-59fb-bf33-9dea223ec2d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB56040',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 291837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-04-30',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.9 TDI Goal',
 'transmission': 'manual',
 'trim': 'Goal',
 'year': 2006}
2026-03-29 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB56040%27 HTTP/1.1" 200 None
2026-03-29 10:35:30 [auto1.de] INFO: Saving data for BB56040: {'auction_closing_time': 1774884047.0, 'created_time': 1773383028.801324, 'last_price_update_time': 1774780530.421405}
2026-03-29 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB56040') HTTP/1.1" 204 0
2026-03-29 10:35:30 [auto1.de] INFO: Found listing with ID: KY70270
2026-03-29 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY70270%27 HTTP/1.1" 200 None
2026-03-29 10:35:30 [auto1.de] INFO: Scrape type for KY70270: 2
2026-03-29 10:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 440dbb43-1235-5d4e-b323-5866c691c9ab with identifier: KY70270
2026-03-29 10:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 440dbb43-1235-5d4e-b323-5866c691c9ab with scrape type 2
2026-03-29 10:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 440dbb43-1235-5d4e-b323-5866c691c9ab with scrape type 2
2026-03-29 10:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 440dbb43-1235-5d4e-b323-5866c691c9ab, identifier: KY70270
2026-03-29 10:35:30 [auto1.de] INFO: Found listing with ID: KY70270
2026-03-29 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY70270%27 HTTP/1.1" 200 None
2026-03-29 10:35:30 [auto1.de] INFO: Scrape type for KY70270: 2
2026-03-29 10:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 440dbb43-1235-5d4e-b323-5866c691c9ab with scrape type 2
2026-03-29 10:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 440dbb43-1235-5d4e-b323-5866c691c9ab with scrape type 2
2026-03-29 10:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 440dbb43-1235-5d4e-b323-5866c691c9ab, identifier: KY70270
2026-03-29 10:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 440dbb43-1235-5d4e-b323-5866c691c9ab with identifier: KY70270
2026-03-29 10:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 440dbb43-1235-5d4e-b323-5866c691c9ab with identifier: KY70270
2026-03-29 10:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 440dbb43-1235-5d4e-b323-5866c691c9ab with identifier: KY70270 to the API
2026-03-29 10:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:13:30Z',
 'fuel_type': 'diesel',
 'id': '440dbb43-1235-5d4e-b323-5866c691c9ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY70270',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 314100,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-04-30',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2004}
2026-03-29 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY70270%27 HTTP/1.1" 200 None
2026-03-29 10:35:31 [auto1.de] INFO: Saving data for KY70270: {'auction_closing_time': 1774883610.0, 'created_time': 1773427180.089786, 'last_price_update_time': 1774780531.009603}
2026-03-29 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY70270') HTTP/1.1" 204 0
2026-03-29 10:35:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 440dbb43-1235-5d4e-b323-5866c691c9ab with identifier: KY70270
2026-03-29 10:35:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 440dbb43-1235-5d4e-b323-5866c691c9ab with identifier: KY70270
2026-03-29 10:35:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 440dbb43-1235-5d4e-b323-5866c691c9ab with identifier: KY70270 to the API
2026-03-29 10:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:13:30Z',
 'fuel_type': 'diesel',
 'id': '440dbb43-1235-5d4e-b323-5866c691c9ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY70270',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 314100,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-04-30',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2004}
2026-03-29 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY70270%27 HTTP/1.1" 200 None
2026-03-29 10:35:31 [auto1.de] INFO: Saving data for KY70270: {'auction_closing_time': 1774883610.0, 'created_time': 1773427180.089786, 'last_price_update_time': 1774780531.505308}
2026-03-29 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY70270') HTTP/1.1" 204 0
2026-03-29 10:35:31 [auto1.de] INFO: Found listing with ID: JS58048
2026-03-29 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS58048%27 HTTP/1.1" 200 None
2026-03-29 10:35:31 [auto1.de] INFO: Scrape type for JS58048: 2
2026-03-29 10:35:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b184eea-ae70-5c25-8b65-ab06576dccf1 with identifier: JS58048
2026-03-29 10:35:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b184eea-ae70-5c25-8b65-ab06576dccf1 with scrape type 2
2026-03-29 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b184eea-ae70-5c25-8b65-ab06576dccf1 with scrape type 2
2026-03-29 10:35:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b184eea-ae70-5c25-8b65-ab06576dccf1, identifier: JS58048
2026-03-29 10:35:31 [auto1.de] INFO: Found listing with ID: JS58048
2026-03-29 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS58048%27 HTTP/1.1" 200 None
2026-03-29 10:35:31 [auto1.de] INFO: Scrape type for JS58048: 2
2026-03-29 10:35:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b184eea-ae70-5c25-8b65-ab06576dccf1 with scrape type 2
2026-03-29 10:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b184eea-ae70-5c25-8b65-ab06576dccf1 with scrape type 2
2026-03-29 10:35:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b184eea-ae70-5c25-8b65-ab06576dccf1, identifier: JS58048
2026-03-29 10:35:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b184eea-ae70-5c25-8b65-ab06576dccf1 with identifier: JS58048
2026-03-29 10:35:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b184eea-ae70-5c25-8b65-ab06576dccf1 with identifier: JS58048
2026-03-29 10:35:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b184eea-ae70-5c25-8b65-ab06576dccf1 with identifier: JS58048 to the API
2026-03-29 10:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:17:54Z',
 'fuel_type': 'petrol',
 'id': '8b184eea-ae70-5c25-8b65-ab06576dccf1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS58048',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 200542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-13',
 'seller_name': None,
 'title': 'Hyundai i10 1.1 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2012}
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS58048%27 HTTP/1.1" 200 None
2026-03-29 10:35:32 [auto1.de] INFO: Saving data for JS58048: {'auction_closing_time': 1774883874.0, 'created_time': 1774638008.360211, 'last_price_update_time': 1774780532.07712}
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JS58048') HTTP/1.1" 204 0
2026-03-29 10:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b184eea-ae70-5c25-8b65-ab06576dccf1 with identifier: JS58048
2026-03-29 10:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b184eea-ae70-5c25-8b65-ab06576dccf1 with identifier: JS58048
2026-03-29 10:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b184eea-ae70-5c25-8b65-ab06576dccf1 with identifier: JS58048 to the API
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:17:54Z',
 'fuel_type': 'petrol',
 'id': '8b184eea-ae70-5c25-8b65-ab06576dccf1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS58048',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 200542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-13',
 'seller_name': None,
 'title': 'Hyundai i10 1.1 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2012}
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS58048%27 HTTP/1.1" 200 None
2026-03-29 10:35:32 [auto1.de] INFO: Saving data for JS58048: {'auction_closing_time': 1774883874.0, 'created_time': 1774638008.360211, 'last_price_update_time': 1774780532.364235}
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JS58048') HTTP/1.1" 204 0
2026-03-29 10:35:32 [auto1.de] INFO: Found listing with ID: RC36772
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC36772%27 HTTP/1.1" 200 None
2026-03-29 10:35:32 [auto1.de] INFO: Scrape type for RC36772: 2
2026-03-29 10:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44694af2-e304-579f-975e-20af8a2f9a1f with identifier: RC36772
2026-03-29 10:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44694af2-e304-579f-975e-20af8a2f9a1f with scrape type 2
2026-03-29 10:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44694af2-e304-579f-975e-20af8a2f9a1f with scrape type 2
2026-03-29 10:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44694af2-e304-579f-975e-20af8a2f9a1f, identifier: RC36772
2026-03-29 10:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:32 [auto1.de] INFO: Found listing with ID: RC36772
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC36772%27 HTTP/1.1" 200 None
2026-03-29 10:35:32 [auto1.de] INFO: Scrape type for RC36772: 2
2026-03-29 10:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44694af2-e304-579f-975e-20af8a2f9a1f with scrape type 2
2026-03-29 10:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44694af2-e304-579f-975e-20af8a2f9a1f with scrape type 2
2026-03-29 10:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44694af2-e304-579f-975e-20af8a2f9a1f, identifier: RC36772
2026-03-29 10:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44694af2-e304-579f-975e-20af8a2f9a1f with identifier: RC36772
2026-03-29 10:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44694af2-e304-579f-975e-20af8a2f9a1f with identifier: RC36772
2026-03-29 10:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44694af2-e304-579f-975e-20af8a2f9a1f with identifier: RC36772 to the API
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:22:03Z',
 'fuel_type': 'diesel',
 'id': '44694af2-e304-579f-975e-20af8a2f9a1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC36772',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 116223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-23',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 d T Plus',
 'transmission': 'automatic',
 'trim': 'T Plus',
 'year': 2017}
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC36772%27 HTTP/1.1" 200 None
2026-03-29 10:35:32 [auto1.de] INFO: Saving data for RC36772: {'auction_closing_time': 1774884123.0, 'created_time': 1774550901.915807, 'last_price_update_time': 1774780532.949212}
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC36772') HTTP/1.1" 204 0
2026-03-29 10:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44694af2-e304-579f-975e-20af8a2f9a1f with identifier: RC36772
2026-03-29 10:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44694af2-e304-579f-975e-20af8a2f9a1f with identifier: RC36772
2026-03-29 10:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44694af2-e304-579f-975e-20af8a2f9a1f with identifier: RC36772 to the API
2026-03-29 10:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:22:03Z',
 'fuel_type': 'diesel',
 'id': '44694af2-e304-579f-975e-20af8a2f9a1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC36772',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 116223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-23',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 d T Plus',
 'transmission': 'automatic',
 'trim': 'T Plus',
 'year': 2017}
2026-03-29 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC36772%27 HTTP/1.1" 200 None
2026-03-29 10:35:33 [auto1.de] INFO: Saving data for RC36772: {'auction_closing_time': 1774884123.0, 'created_time': 1774550901.915807, 'last_price_update_time': 1774780533.245049}
2026-03-29 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC36772') HTTP/1.1" 204 0
2026-03-29 10:35:33 [auto1.de] INFO: Found listing with ID: UG24074
2026-03-29 10:35:33 [auto1.de] INFO: Found listing with ID: RE36292
2026-03-29 10:35:33 [auto1.de] INFO: Found listing with ID: ZA01516
2026-03-29 10:35:33 [auto1.de] INFO: Found listing with ID: KF39369
2026-03-29 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF39369%27 HTTP/1.1" 200 None
2026-03-29 10:35:33 [auto1.de] INFO: Scrape type for KF39369: 2
2026-03-29 10:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c2ef6a4-9e78-5ea9-97ad-0a32b05d6829 with identifier: KF39369
2026-03-29 10:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c2ef6a4-9e78-5ea9-97ad-0a32b05d6829 with scrape type 2
2026-03-29 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c2ef6a4-9e78-5ea9-97ad-0a32b05d6829 with scrape type 2
2026-03-29 10:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c2ef6a4-9e78-5ea9-97ad-0a32b05d6829, identifier: KF39369
2026-03-29 10:35:33 [auto1.de] INFO: Found listing with ID: UG24074
2026-03-29 10:35:33 [auto1.de] INFO: Found listing with ID: RE36292
2026-03-29 10:35:33 [auto1.de] INFO: Found listing with ID: ZA01516
2026-03-29 10:35:33 [auto1.de] INFO: Found listing with ID: KF39369
2026-03-29 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF39369%27 HTTP/1.1" 200 None
2026-03-29 10:35:33 [auto1.de] INFO: Scrape type for KF39369: 2
2026-03-29 10:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c2ef6a4-9e78-5ea9-97ad-0a32b05d6829 with scrape type 2
2026-03-29 10:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c2ef6a4-9e78-5ea9-97ad-0a32b05d6829 with scrape type 2
2026-03-29 10:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c2ef6a4-9e78-5ea9-97ad-0a32b05d6829, identifier: KF39369
2026-03-29 10:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c2ef6a4-9e78-5ea9-97ad-0a32b05d6829 with identifier: KF39369
2026-03-29 10:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c2ef6a4-9e78-5ea9-97ad-0a32b05d6829 with identifier: KF39369
2026-03-29 10:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c2ef6a4-9e78-5ea9-97ad-0a32b05d6829 with identifier: KF39369 to the API
2026-03-29 10:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-30T15:12:24Z',
 'fuel_type': 'petrol',
 'id': '9c2ef6a4-9e78-5ea9-97ad-0a32b05d6829',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF39369',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Almera',
 'odometer': 125567,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-03-21',
 'seller_name': None,
 'title': 'Nissan Almera 1.5 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2005}
2026-03-29 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF39369%27 HTTP/1.1" 200 None
2026-03-29 10:35:34 [auto1.de] INFO: Saving data for KF39369: {'auction_closing_time': 1774883544.0, 'created_time': 1774551653.069878, 'last_price_update_time': 1774780534.517863}
2026-03-29 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF39369') HTTP/1.1" 204 0
2026-03-29 10:35:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c2ef6a4-9e78-5ea9-97ad-0a32b05d6829 with identifier: KF39369
2026-03-29 10:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c2ef6a4-9e78-5ea9-97ad-0a32b05d6829 with identifier: KF39369
2026-03-29 10:35:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c2ef6a4-9e78-5ea9-97ad-0a32b05d6829 with identifier: KF39369 to the API
2026-03-29 10:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-30T15:12:24Z',
 'fuel_type': 'petrol',
 'id': '9c2ef6a4-9e78-5ea9-97ad-0a32b05d6829',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF39369',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Almera',
 'odometer': 125567,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-03-21',
 'seller_name': None,
 'title': 'Nissan Almera 1.5 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2005}
2026-03-29 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF39369%27 HTTP/1.1" 200 None
2026-03-29 10:35:34 [auto1.de] INFO: Saving data for KF39369: {'auction_closing_time': 1774883544.0, 'created_time': 1774551653.069878, 'last_price_update_time': 1774780534.949161}
2026-03-29 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF39369') HTTP/1.1" 204 0
2026-03-29 10:35:34 [auto1.de] INFO: Found listing with ID: NX65869
2026-03-29 10:35:34 [auto1.de] INFO: Found listing with ID: CX65130
2026-03-29 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX65130%27 HTTP/1.1" 200 None
2026-03-29 10:35:34 [auto1.de] INFO: Scrape type for CX65130: 2
2026-03-29 10:35:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18a5206f-4341-5979-b6ed-a93b1da77879 with identifier: CX65130
2026-03-29 10:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18a5206f-4341-5979-b6ed-a93b1da77879 with scrape type 2
2026-03-29 10:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18a5206f-4341-5979-b6ed-a93b1da77879 with scrape type 2
2026-03-29 10:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18a5206f-4341-5979-b6ed-a93b1da77879, identifier: CX65130
2026-03-29 10:35:35 [auto1.de] INFO: Found listing with ID: NX65869
2026-03-29 10:35:35 [auto1.de] INFO: Found listing with ID: CX65130
2026-03-29 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX65130%27 HTTP/1.1" 200 None
2026-03-29 10:35:35 [auto1.de] INFO: Scrape type for CX65130: 2
2026-03-29 10:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18a5206f-4341-5979-b6ed-a93b1da77879 with scrape type 2
2026-03-29 10:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18a5206f-4341-5979-b6ed-a93b1da77879 with scrape type 2
2026-03-29 10:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18a5206f-4341-5979-b6ed-a93b1da77879, identifier: CX65130
2026-03-29 10:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18a5206f-4341-5979-b6ed-a93b1da77879 with identifier: CX65130
2026-03-29 10:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 10:35:35 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-29 10:35:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 10:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 10:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18a5206f-4341-5979-b6ed-a93b1da77879 with identifier: CX65130
2026-03-29 10:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18a5206f-4341-5979-b6ed-a93b1da77879 with identifier: CX65130 to the API
2026-03-29 10:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:11:14Z',
 'fuel_type': 'petrol',
 'id': '18a5206f-4341-5979-b6ed-a93b1da77879',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX65130',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Colt',
 'odometer': 209805,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-05-03',
 'seller_name': None,
 'title': 'Mitsubishi Colt 1.3 Invite',
 'transmission': 'manual',
 'trim': 'Invite',
 'year': 2005}
2026-03-29 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX65130%27 HTTP/1.1" 200 None
2026-03-29 10:35:36 [auto1.de] INFO: Saving data for CX65130: {'auction_closing_time': 1774883474.0, 'created_time': 1773401243.954496, 'last_price_update_time': 1774780536.572829}
2026-03-29 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CX65130') HTTP/1.1" 204 0
2026-03-29 10:35:36 [auto1.de] INFO: Channel: 24h | Page: 2 | totalHits: 6726 | hits on page: 40
2026-03-29 10:35:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18a5206f-4341-5979-b6ed-a93b1da77879 with identifier: CX65130
2026-03-29 10:35:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18a5206f-4341-5979-b6ed-a93b1da77879 with identifier: CX65130
2026-03-29 10:35:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18a5206f-4341-5979-b6ed-a93b1da77879 with identifier: CX65130 to the API
2026-03-29 10:35:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:11:14Z',
 'fuel_type': 'petrol',
 'id': '18a5206f-4341-5979-b6ed-a93b1da77879',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX65130',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Colt',
 'odometer': 209805,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-05-03',
 'seller_name': None,
 'title': 'Mitsubishi Colt 1.3 Invite',
 'transmission': 'manual',
 'trim': 'Invite',
 'year': 2005}
2026-03-29 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX65130%27 HTTP/1.1" 200 None
2026-03-29 10:35:36 [auto1.de] INFO: Saving data for CX65130: {'auction_closing_time': 1774883474.0, 'created_time': 1773401243.954496, 'last_price_update_time': 1774780536.866486}
2026-03-29 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CX65130') HTTP/1.1" 204 0
2026-03-29 10:35:36 [auto1.de] INFO: Found listing with ID: EM69588
2026-03-29 10:35:36 [auto1.de] INFO: Found listing with ID: FY70837
2026-03-29 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY70837%27 HTTP/1.1" 200 None
2026-03-29 10:35:36 [auto1.de] INFO: Scrape type for FY70837: 2
2026-03-29 10:35:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0481b56-dde9-549a-9e45-99aa4debc7e8 with identifier: FY70837
2026-03-29 10:35:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0481b56-dde9-549a-9e45-99aa4debc7e8 with scrape type 2
2026-03-29 10:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0481b56-dde9-549a-9e45-99aa4debc7e8 with scrape type 2
2026-03-29 10:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e0481b56-dde9-549a-9e45-99aa4debc7e8, identifier: FY70837
2026-03-29 10:35:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e0481b56-dde9-549a-9e45-99aa4debc7e8 with identifier: FY70837
2026-03-29 10:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e0481b56-dde9-549a-9e45-99aa4debc7e8 with identifier: FY70837
2026-03-29 10:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e0481b56-dde9-549a-9e45-99aa4debc7e8 with identifier: FY70837 to the API
2026-03-29 10:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:08:05Z',
 'fuel_type': 'petrol',
 'id': 'e0481b56-dde9-549a-9e45-99aa4debc7e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY70837',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 62042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-28',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 Edition 2020 AMG Line',
 'transmission': 'automatic',
 'trim': 'Edition 2020 AMG Line',
 'year': 2021}
2026-03-29 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY70837%27 HTTP/1.1" 200 None
2026-03-29 10:35:37 [auto1.de] INFO: Saving data for FY70837: {'auction_closing_time': 1774883285.0, 'created_time': 1774292712.867713, 'last_price_update_time': 1774780537.362262}
2026-03-29 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY70837') HTTP/1.1" 204 0
2026-03-29 10:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AB70277> (referer: https://www.auto1.com/v1/car-details-view/AB70277/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:37 [auto1.de] INFO: Found listing with ID: YL11317
2026-03-29 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL11317%27 HTTP/1.1" 200 None
2026-03-29 10:35:37 [auto1.de] INFO: Scrape type for YL11317: 2
2026-03-29 10:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 287fb1b3-4d7a-5e7e-b033-e10b55591b61 with identifier: YL11317
2026-03-29 10:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 287fb1b3-4d7a-5e7e-b033-e10b55591b61 with scrape type 2
2026-03-29 10:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 287fb1b3-4d7a-5e7e-b033-e10b55591b61 with scrape type 2
2026-03-29 10:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 287fb1b3-4d7a-5e7e-b033-e10b55591b61, identifier: YL11317
2026-03-29 10:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 287fb1b3-4d7a-5e7e-b033-e10b55591b61 with identifier: YL11317
2026-03-29 10:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 10:35:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-29 10:35:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 10:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 287fb1b3-4d7a-5e7e-b033-e10b55591b61 with identifier: YL11317
2026-03-29 10:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 287fb1b3-4d7a-5e7e-b033-e10b55591b61 with identifier: YL11317 to the API
2026-03-29 10:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:36:58Z',
 'fuel_type': 'petrol',
 'id': '287fb1b3-4d7a-5e7e-b033-e10b55591b61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL11317',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 229567,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-28',
 'seller_name': None,
 'title': 'Audi A1 1.4 TFSI Attraction',
 'transmission': 'automatic',
 'trim': 'Attraction',
 'year': 2010}
2026-03-29 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL11317%27 HTTP/1.1" 200 None
2026-03-29 10:35:37 [auto1.de] INFO: Saving data for YL11317: {'auction_closing_time': 1774885018.0, 'created_time': 1773427050.207461, 'last_price_update_time': 1774780537.98104}
2026-03-29 10:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YL11317') HTTP/1.1" 204 0
2026-03-29 10:35:38 [auto1.de] INFO: Found listing with ID: RA38840
2026-03-29 10:35:38 [auto1.de] INFO: Found listing with ID: ZH40630
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH40630%27 HTTP/1.1" 200 None
2026-03-29 10:35:38 [auto1.de] INFO: Scrape type for ZH40630: 2
2026-03-29 10:35:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26bbd0b7-df5b-5d4f-9bf1-0c1b5572c0c0 with identifier: ZH40630
2026-03-29 10:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26bbd0b7-df5b-5d4f-9bf1-0c1b5572c0c0 with scrape type 2
2026-03-29 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26bbd0b7-df5b-5d4f-9bf1-0c1b5572c0c0 with scrape type 2
2026-03-29 10:35:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 26bbd0b7-df5b-5d4f-9bf1-0c1b5572c0c0, identifier: ZH40630
2026-03-29 10:35:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 26bbd0b7-df5b-5d4f-9bf1-0c1b5572c0c0 with identifier: ZH40630
2026-03-29 10:35:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 26bbd0b7-df5b-5d4f-9bf1-0c1b5572c0c0 with identifier: ZH40630
2026-03-29 10:35:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 26bbd0b7-df5b-5d4f-9bf1-0c1b5572c0c0 with identifier: ZH40630 to the API
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:13:45Z',
 'fuel_type': 'petrol',
 'id': '26bbd0b7-df5b-5d4f-9bf1-0c1b5572c0c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH40630',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 118041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-02-06',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4',
 'transmission': 'manual',
 'trim': '',
 'year': 2002}
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH40630%27 HTTP/1.1" 200 None
2026-03-29 10:35:38 [auto1.de] INFO: Saving data for ZH40630: {'auction_closing_time': 1774883625.0, 'created_time': 1774550868.470208, 'last_price_update_time': 1774780538.465127}
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZH40630') HTTP/1.1" 204 0
2026-03-29 10:35:38 [auto1.de] INFO: Found listing with ID: RR52693
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR52693%27 HTTP/1.1" 200 None
2026-03-29 10:35:38 [auto1.de] INFO: Scrape type for RR52693: 2
2026-03-29 10:35:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8df8c237-dc35-582b-98aa-1d30076b069f with identifier: RR52693
2026-03-29 10:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8df8c237-dc35-582b-98aa-1d30076b069f with scrape type 2
2026-03-29 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8df8c237-dc35-582b-98aa-1d30076b069f with scrape type 2
2026-03-29 10:35:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8df8c237-dc35-582b-98aa-1d30076b069f, identifier: RR52693
2026-03-29 10:35:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8df8c237-dc35-582b-98aa-1d30076b069f with identifier: RR52693
2026-03-29 10:35:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8df8c237-dc35-582b-98aa-1d30076b069f with identifier: RR52693
2026-03-29 10:35:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8df8c237-dc35-582b-98aa-1d30076b069f with identifier: RR52693 to the API
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:16:52Z',
 'fuel_type': 'petrol',
 'id': '8df8c237-dc35-582b-98aa-1d30076b069f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR52693',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 264293,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-03-18',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Kompressor Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2003}
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR52693%27 HTTP/1.1" 200 None
2026-03-29 10:35:38 [auto1.de] INFO: Saving data for RR52693: {'auction_closing_time': 1774883812.0, 'created_time': 1774550686.785911, 'last_price_update_time': 1774780538.940409}
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RR52693') HTTP/1.1" 204 0
2026-03-29 10:35:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebc2c45f-6c3d-5f0c-a84d-406887c2f31b with identifier: AB70277
2026-03-29 10:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebc2c45f-6c3d-5f0c-a84d-406887c2f31b with scrape type 1
2026-03-29 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ebc2c45f-6c3d-5f0c-a84d-406887c2f31b
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F31%252Fa03169667076b7eb2581351aeba6d288%252Fpa%252FAB70277_52dc04444d7c46ef81dd2bc8173049e0.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/31/a03169667076b7eb2581351aeba6d288/pa/AB70277_52dc04444d7c46ef81dd2bc8173049e0.jpg already downloaded
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F31%252Fa03169667076b7eb2581351aeba6d288%252Fpa%252FAB70277_74a8695bda467e5fc12a67adfdb1555c.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/31/a03169667076b7eb2581351aeba6d288/pa/AB70277_74a8695bda467e5fc12a67adfdb1555c.jpg already downloaded
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F31%252Fa03169667076b7eb2581351aeba6d288%252Fpa%252FAB70277_9b9357c242e964db2b21d11db842eb23.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/31/a03169667076b7eb2581351aeba6d288/pa/AB70277_9b9357c242e964db2b21d11db842eb23.jpg already downloaded
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F31%252Fa03169667076b7eb2581351aeba6d288%252Fpa%252FAB70277_d353c17c3b193781aa8b1745ddf14224.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/31/a03169667076b7eb2581351aeba6d288/pa/AB70277_d353c17c3b193781aa8b1745ddf14224.jpg already downloaded
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F31%252Fa03169667076b7eb2581351aeba6d288%252Fpa%252FAB70277_b62e62a627470832859183f448d43ce4.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/31/a03169667076b7eb2581351aeba6d288/pa/AB70277_b62e62a627470832859183f448d43ce4.jpg already downloaded
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F31%252Fa03169667076b7eb2581351aeba6d288%252Fpa%252FAB70277_77276cbf5f7430f572a966f78694595c.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/31/a03169667076b7eb2581351aeba6d288/pa/AB70277_77276cbf5f7430f572a966f78694595c.jpg already downloaded
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F31%252Fa03169667076b7eb2581351aeba6d288%252Fpa%252FAB70277_ce87af1c54f3b3129b07963d79f62890.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/31/a03169667076b7eb2581351aeba6d288/pa/AB70277_ce87af1c54f3b3129b07963d79f62890.jpg already downloaded
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F31%252Fa03169667076b7eb2581351aeba6d288%252Fpa%252FAB70277_9941b34f7cac53b8fbaa4dd9e271b5ea.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/31/a03169667076b7eb2581351aeba6d288/pa/AB70277_9941b34f7cac53b8fbaa4dd9e271b5ea.jpg already downloaded
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F31%252Fa03169667076b7eb2581351aeba6d288%252Fpa%252FAB70277_33b78e899b6728de239248e77539a7e9.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/31/a03169667076b7eb2581351aeba6d288/pa/AB70277_33b78e899b6728de239248e77539a7e9.jpg already downloaded
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F31%252Fa03169667076b7eb2581351aeba6d288%252Fpa%252FAB70277_cdb99ef4a667f87cf280904a6a69554e.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/31/a03169667076b7eb2581351aeba6d288/pa/AB70277_cdb99ef4a667f87cf280904a6a69554e.jpg already downloaded
2026-03-29 10:35:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ebc2c45f-6c3d-5f0c-a84d-406887c2f31b, identifier: AB70277
2026-03-29 10:35:39 [auto1.de] INFO: Found listing with ID: NK75444
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK75444%27 HTTP/1.1" 200 None
2026-03-29 10:35:39 [auto1.de] INFO: Scrape type for NK75444: 2
2026-03-29 10:35:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ba55716-6ea1-5529-b3e3-456a4c66517f with identifier: NK75444
2026-03-29 10:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ba55716-6ea1-5529-b3e3-456a4c66517f with scrape type 2
2026-03-29 10:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ba55716-6ea1-5529-b3e3-456a4c66517f with scrape type 2
2026-03-29 10:35:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ba55716-6ea1-5529-b3e3-456a4c66517f, identifier: NK75444
2026-03-29 10:35:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ebc2c45f-6c3d-5f0c-a84d-406887c2f31b with identifier: AB70277
2026-03-29 10:35:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ebc2c45f-6c3d-5f0c-a84d-406887c2f31b with identifier: AB70277
2026-03-29 10:35:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ebc2c45f-6c3d-5f0c-a84d-406887c2f31b with identifier: AB70277 to the API
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AB70277>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:24:03Z',
 'fuel_type': 'petrol',
 'id': 'ebc2c45f-6c3d-5f0c-a84d-406887c2f31b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB70277',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 46386,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imga0/31/a03169667076b7eb2581351aeba6d288/pa/AB70277_52dc04444d7c46ef81dd2bc8173049e0.jpg',
                'https://img-pa.auto1.com/imga0/31/a03169667076b7eb2581351aeba6d288/pa/AB70277_74a8695bda467e5fc12a67adfdb1555c.jpg',
                'https://img-pa.auto1.com/imga0/31/a03169667076b7eb2581351aeba6d288/pa/AB70277_9b9357c242e964db2b21d11db842eb23.jpg',
                'https://img-pa.auto1.com/imga0/31/a03169667076b7eb2581351aeba6d288/pa/AB70277_d353c17c3b193781aa8b1745ddf14224.jpg',
                'https://img-pa.auto1.com/imga0/31/a03169667076b7eb2581351aeba6d288/pa/AB70277_b62e62a627470832859183f448d43ce4.jpg',
                'https://img-pa.auto1.com/imga0/31/a03169667076b7eb2581351aeba6d288/pa/AB70277_77276cbf5f7430f572a966f78694595c.jpg',
                'https://img-pa.auto1.com/imga0/31/a03169667076b7eb2581351aeba6d288/pa/AB70277_ce87af1c54f3b3129b07963d79f62890.jpg',
                'https://img-pa.auto1.com/imga0/31/a03169667076b7eb2581351aeba6d288/pa/AB70277_9941b34f7cac53b8fbaa4dd9e271b5ea.jpg',
                'https://img-pa.auto1.com/imga0/31/a03169667076b7eb2581351aeba6d288/pa/AB70277_33b78e899b6728de239248e77539a7e9.jpg',
                'https://img-pa.auto1.com/imga0/31/a03169667076b7eb2581351aeba6d288/pa/AB70277_cdb99ef4a667f87cf280904a6a69554e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebc2c45f-6c3d-5f0c-a84d-406887c2f31b/ebc2c45f-6c3d-5f0c-a84d-406887c2f31b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/31/a03169667076b7eb2581351aeba6d288/pa/AB70277_52dc04444d7c46ef81dd2bc8173049e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebc2c45f-6c3d-5f0c-a84d-406887c2f31b/ebc2c45f-6c3d-5f0c-a84d-406887c2f31b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/31/a03169667076b7eb2581351aeba6d288/pa/AB70277_74a8695bda467e5fc12a67adfdb1555c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebc2c45f-6c3d-5f0c-a84d-406887c2f31b/ebc2c45f-6c3d-5f0c-a84d-406887c2f31b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79535,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/31/a03169667076b7eb2581351aeba6d288/pa/AB70277_9b9357c242e964db2b21d11db842eb23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebc2c45f-6c3d-5f0c-a84d-406887c2f31b/ebc2c45f-6c3d-5f0c-a84d-406887c2f31b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/31/a03169667076b7eb2581351aeba6d288/pa/AB70277_d353c17c3b193781aa8b1745ddf14224.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebc2c45f-6c3d-5f0c-a84d-406887c2f31b/ebc2c45f-6c3d-5f0c-a84d-406887c2f31b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70224,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/31/a03169667076b7eb2581351aeba6d288/pa/AB70277_b62e62a627470832859183f448d43ce4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebc2c45f-6c3d-5f0c-a84d-406887c2f31b/ebc2c45f-6c3d-5f0c-a84d-406887c2f31b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/31/a03169667076b7eb2581351aeba6d288/pa/AB70277_77276cbf5f7430f572a966f78694595c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebc2c45f-6c3d-5f0c-a84d-406887c2f31b/ebc2c45f-6c3d-5f0c-a84d-406887c2f31b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/31/a03169667076b7eb2581351aeba6d288/pa/AB70277_ce87af1c54f3b3129b07963d79f62890.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebc2c45f-6c3d-5f0c-a84d-406887c2f31b/ebc2c45f-6c3d-5f0c-a84d-406887c2f31b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/31/a03169667076b7eb2581351aeba6d288/pa/AB70277_9941b34f7cac53b8fbaa4dd9e271b5ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebc2c45f-6c3d-5f0c-a84d-406887c2f31b/ebc2c45f-6c3d-5f0c-a84d-406887c2f31b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78515,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/31/a03169667076b7eb2581351aeba6d288/pa/AB70277_33b78e899b6728de239248e77539a7e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebc2c45f-6c3d-5f0c-a84d-406887c2f31b/ebc2c45f-6c3d-5f0c-a84d-406887c2f31b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72805,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/31/a03169667076b7eb2581351aeba6d288/pa/AB70277_cdb99ef4a667f87cf280904a6a69554e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.5 TSI ACT FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2020}
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB70277%27 HTTP/1.1" 200 None
2026-03-29 10:35:39 [auto1.de] INFO: Saving data for AB70277: {'created_time': 1774780539.750724, 'last_price_update_time': 1774780539.750736, 'auction_closing_time': 1774884243.0}
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB70277') HTTP/1.1" 204 0
2026-03-29 10:35:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ba55716-6ea1-5529-b3e3-456a4c66517f with identifier: NK75444
2026-03-29 10:35:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ba55716-6ea1-5529-b3e3-456a4c66517f with identifier: NK75444
2026-03-29 10:35:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ba55716-6ea1-5529-b3e3-456a4c66517f with identifier: NK75444 to the API
2026-03-29 10:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:09:48Z',
 'fuel_type': 'diesel',
 'id': '4ba55716-6ea1-5529-b3e3-456a4c66517f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK75444',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 273190,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-31',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.9 TDI Goal',
 'transmission': 'manual',
 'trim': 'Goal',
 'year': 2006}
2026-03-29 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK75444%27 HTTP/1.1" 200 None
2026-03-29 10:35:41 [auto1.de] INFO: Saving data for NK75444: {'auction_closing_time': 1774883388.0, 'created_time': 1774638270.802446, 'last_price_update_time': 1774780541.045489}
2026-03-29 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NK75444') HTTP/1.1" 204 0
2026-03-29 10:35:41 [auto1.de] INFO: Found listing with ID: ES51146
2026-03-29 10:35:41 [auto1.de] INFO: Found listing with ID: RC32924
2026-03-29 10:35:41 [auto1.de] INFO: Found listing with ID: AA06623
2026-03-29 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA06623%27 HTTP/1.1" 200 None
2026-03-29 10:35:41 [auto1.de] INFO: Scrape type for AA06623: 2
2026-03-29 10:35:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8e7d56a-3463-567e-917f-3a2456aea3ae with identifier: AA06623
2026-03-29 10:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8e7d56a-3463-567e-917f-3a2456aea3ae with scrape type 2
2026-03-29 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8e7d56a-3463-567e-917f-3a2456aea3ae with scrape type 2
2026-03-29 10:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8e7d56a-3463-567e-917f-3a2456aea3ae, identifier: AA06623
2026-03-29 10:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8e7d56a-3463-567e-917f-3a2456aea3ae with identifier: AA06623
2026-03-29 10:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8e7d56a-3463-567e-917f-3a2456aea3ae with identifier: AA06623
2026-03-29 10:35:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8e7d56a-3463-567e-917f-3a2456aea3ae with identifier: AA06623 to the API
2026-03-29 10:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:33:40Z',
 'fuel_type': 'petrol',
 'id': 'f8e7d56a-3463-567e-917f-3a2456aea3ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA06623',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 186143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-29',
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 THP Premium',
 'transmission': 'automatic',
 'trim': 'Premium',
 'year': 2010}
2026-03-29 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA06623%27 HTTP/1.1" 200 None
2026-03-29 10:35:41 [auto1.de] INFO: Saving data for AA06623: {'auction_closing_time': 1774884820.0, 'created_time': 1774550682.858944, 'last_price_update_time': 1774780541.619591}
2026-03-29 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AA06623') HTTP/1.1" 204 0
2026-03-29 10:35:41 [auto1.de] INFO: Found listing with ID: VY63295
2026-03-29 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY63295%27 HTTP/1.1" 200 None
2026-03-29 10:35:41 [auto1.de] INFO: Scrape type for VY63295: 1
2026-03-29 10:35:41 [auto1.de] INFO: Found listing with ID: XN76849
2026-03-29 10:35:41 [auto1.de] INFO: Found listing with ID: KV42803
2026-03-29 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV42803%27 HTTP/1.1" 200 None
2026-03-29 10:35:41 [auto1.de] INFO: Scrape type for KV42803: 2
2026-03-29 10:35:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3770eb57-43b8-5eb1-ba3f-633244321d1d with identifier: KV42803
2026-03-29 10:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3770eb57-43b8-5eb1-ba3f-633244321d1d with scrape type 2
2026-03-29 10:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3770eb57-43b8-5eb1-ba3f-633244321d1d with scrape type 2
2026-03-29 10:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3770eb57-43b8-5eb1-ba3f-633244321d1d, identifier: KV42803
2026-03-29 10:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3770eb57-43b8-5eb1-ba3f-633244321d1d with identifier: KV42803
2026-03-29 10:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3770eb57-43b8-5eb1-ba3f-633244321d1d with identifier: KV42803
2026-03-29 10:35:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3770eb57-43b8-5eb1-ba3f-633244321d1d with identifier: KV42803 to the API
2026-03-29 10:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:41:40Z',
 'fuel_type': 'petrol',
 'id': '3770eb57-43b8-5eb1-ba3f-633244321d1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV42803',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 140734,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-05',
 'seller_name': None,
 'title': 'Hyundai i10 1.1 Edition+',
 'transmission': 'manual',
 'trim': 'Edition+',
 'year': 2009}
2026-03-29 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV42803%27 HTTP/1.1" 200 None
2026-03-29 10:35:42 [auto1.de] INFO: Saving data for KV42803: {'auction_closing_time': 1774885300.0, 'created_time': 1774550914.846322, 'last_price_update_time': 1774780542.157912}
2026-03-29 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV42803') HTTP/1.1" 204 0
2026-03-29 10:35:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:42 [auto1.de] INFO: Found listing with ID: XF10018
2026-03-29 10:35:42 [auto1.de] INFO: Found listing with ID: TJ48176
2026-03-29 10:35:42 [auto1.de] INFO: Found listing with ID: NH05952
2026-03-29 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH05952%27 HTTP/1.1" 200 None
2026-03-29 10:35:42 [auto1.de] INFO: Scrape type for NH05952: 2
2026-03-29 10:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2371f6f-43d1-5fd7-9147-8c9a3f9dbbd8 with identifier: NH05952
2026-03-29 10:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2371f6f-43d1-5fd7-9147-8c9a3f9dbbd8 with scrape type 2
2026-03-29 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2371f6f-43d1-5fd7-9147-8c9a3f9dbbd8 with scrape type 2
2026-03-29 10:35:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2371f6f-43d1-5fd7-9147-8c9a3f9dbbd8, identifier: NH05952
2026-03-29 10:35:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2371f6f-43d1-5fd7-9147-8c9a3f9dbbd8 with identifier: NH05952
2026-03-29 10:35:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2371f6f-43d1-5fd7-9147-8c9a3f9dbbd8 with identifier: NH05952
2026-03-29 10:35:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2371f6f-43d1-5fd7-9147-8c9a3f9dbbd8 with identifier: NH05952 to the API
2026-03-29 10:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:41:14Z',
 'fuel_type': 'petrol',
 'id': 'd2371f6f-43d1-5fd7-9147-8c9a3f9dbbd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH05952',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 73614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-11',
 'seller_name': None,
 'title': 'Dacia Sandero 1.2 Essentiel',
 'transmission': 'manual',
 'trim': 'Essentiel',
 'year': 2017}
2026-03-29 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH05952%27 HTTP/1.1" 200 None
2026-03-29 10:35:42 [auto1.de] INFO: Saving data for NH05952: {'auction_closing_time': 1774885274.0, 'created_time': 1773224310.812995, 'last_price_update_time': 1774780542.77052}
2026-03-29 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH05952') HTTP/1.1" 204 0
2026-03-29 10:35:42 [auto1.de] INFO: Found listing with ID: WW07339
2026-03-29 10:35:42 [auto1.de] INFO: Found listing with ID: MM90300
2026-03-29 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM90300%27 HTTP/1.1" 200 None
2026-03-29 10:35:42 [auto1.de] INFO: Scrape type for MM90300: 2
2026-03-29 10:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7456e56-261e-58f8-a61a-a335e61b2856 with identifier: MM90300
2026-03-29 10:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7456e56-261e-58f8-a61a-a335e61b2856 with scrape type 2
2026-03-29 10:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7456e56-261e-58f8-a61a-a335e61b2856 with scrape type 2
2026-03-29 10:35:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7456e56-261e-58f8-a61a-a335e61b2856, identifier: MM90300
2026-03-29 10:35:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7456e56-261e-58f8-a61a-a335e61b2856 with identifier: MM90300
2026-03-29 10:35:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7456e56-261e-58f8-a61a-a335e61b2856 with identifier: MM90300
2026-03-29 10:35:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7456e56-261e-58f8-a61a-a335e61b2856 with identifier: MM90300 to the API
2026-03-29 10:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:12:56Z',
 'fuel_type': 'petrol',
 'id': 'f7456e56-261e-58f8-a61a-a335e61b2856',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM90300',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 226749,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-07-16',
 'seller_name': None,
 'title': 'BMW 5er 525i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2001}
2026-03-29 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM90300%27 HTTP/1.1" 200 None
2026-03-29 10:35:43 [auto1.de] INFO: Saving data for MM90300: {'auction_closing_time': 1774883576.0, 'created_time': 1774550674.525616, 'last_price_update_time': 1774780543.235224}
2026-03-29 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM90300') HTTP/1.1" 204 0
2026-03-29 10:35:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:43 [auto1.de] INFO: Found listing with ID: HT08782
2026-03-29 10:35:43 [auto1.de] INFO: Found listing with ID: UH53806
2026-03-29 10:35:43 [auto1.de] INFO: Found listing with ID: LE65557
2026-03-29 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE65557%27 HTTP/1.1" 200 None
2026-03-29 10:35:43 [auto1.de] INFO: Scrape type for LE65557: 2
2026-03-29 10:35:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c06712f-0cec-53ff-b445-3ddee5cc20c2 with identifier: LE65557
2026-03-29 10:35:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c06712f-0cec-53ff-b445-3ddee5cc20c2 with scrape type 2
2026-03-29 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c06712f-0cec-53ff-b445-3ddee5cc20c2 with scrape type 2
2026-03-29 10:35:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c06712f-0cec-53ff-b445-3ddee5cc20c2, identifier: LE65557
2026-03-29 10:35:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c06712f-0cec-53ff-b445-3ddee5cc20c2 with identifier: LE65557
2026-03-29 10:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c06712f-0cec-53ff-b445-3ddee5cc20c2 with identifier: LE65557
2026-03-29 10:35:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c06712f-0cec-53ff-b445-3ddee5cc20c2 with identifier: LE65557 to the API
2026-03-29 10:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:01:22Z',
 'fuel_type': 'petrol',
 'id': '4c06712f-0cec-53ff-b445-3ddee5cc20c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE65557',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Sedici',
 'odometer': 43376,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-30',
 'seller_name': None,
 'title': 'Fiat Sedici 1.6 Pop 4x2',
 'transmission': 'manual',
 'trim': 'Pop 4x2',
 'year': 2012}
2026-03-29 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE65557%27 HTTP/1.1" 200 None
2026-03-29 10:35:43 [auto1.de] INFO: Saving data for LE65557: {'auction_closing_time': 1774882882.0, 'created_time': 1773571557.020828, 'last_price_update_time': 1774780543.795218}
2026-03-29 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LE65557') HTTP/1.1" 204 0
2026-03-29 10:35:43 [auto1.de] INFO: Found listing with ID: LJ58074
2026-03-29 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ58074%27 HTTP/1.1" 200 None
2026-03-29 10:35:43 [auto1.de] INFO: Scrape type for LJ58074: 2
2026-03-29 10:35:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cade1443-cecd-5baa-8fd2-740a130addcc with identifier: LJ58074
2026-03-29 10:35:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cade1443-cecd-5baa-8fd2-740a130addcc with scrape type 2
2026-03-29 10:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cade1443-cecd-5baa-8fd2-740a130addcc with scrape type 2
2026-03-29 10:35:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cade1443-cecd-5baa-8fd2-740a130addcc, identifier: LJ58074
2026-03-29 10:35:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cade1443-cecd-5baa-8fd2-740a130addcc with identifier: LJ58074
2026-03-29 10:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cade1443-cecd-5baa-8fd2-740a130addcc with identifier: LJ58074
2026-03-29 10:35:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cade1443-cecd-5baa-8fd2-740a130addcc with identifier: LJ58074 to the API
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-30T15:40:16Z',
 'fuel_type': 'petrol',
 'id': 'cade1443-cecd-5baa-8fd2-740a130addcc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ58074',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 295018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-16',
 'seller_name': None,
 'title': 'BMW 1er 130i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ58074%27 HTTP/1.1" 200 None
2026-03-29 10:35:44 [auto1.de] INFO: Saving data for LJ58074: {'auction_closing_time': 1774885216.0, 'created_time': 1773304656.76881, 'last_price_update_time': 1774780544.254161}
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ58074') HTTP/1.1" 204 0
2026-03-29 10:35:44 [auto1.de] INFO: Channel: 24h | Page: 3 | totalHits: 6726 | hits on page: 40
2026-03-29 10:35:44 [auto1.de] INFO: Found listing with ID: YY18465
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY18465%27 HTTP/1.1" 200 None
2026-03-29 10:35:44 [auto1.de] INFO: Scrape type for YY18465: 2
2026-03-29 10:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c77d5a41-4c87-5984-bbb7-fc7e6cccc93d with identifier: YY18465
2026-03-29 10:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c77d5a41-4c87-5984-bbb7-fc7e6cccc93d with scrape type 2
2026-03-29 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c77d5a41-4c87-5984-bbb7-fc7e6cccc93d with scrape type 2
2026-03-29 10:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c77d5a41-4c87-5984-bbb7-fc7e6cccc93d, identifier: YY18465
2026-03-29 10:35:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c77d5a41-4c87-5984-bbb7-fc7e6cccc93d with identifier: YY18465
2026-03-29 10:35:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c77d5a41-4c87-5984-bbb7-fc7e6cccc93d with identifier: YY18465
2026-03-29 10:35:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c77d5a41-4c87-5984-bbb7-fc7e6cccc93d with identifier: YY18465 to the API
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 193,
 'expiration_date': '2026-03-30T15:37:56Z',
 'fuel_type': 'petrol',
 'id': 'c77d5a41-4c87-5984-bbb7-fc7e6cccc93d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY18465',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 152037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-07-31',
 'seller_name': None,
 'title': 'Skoda Superb 2.8 V6 Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2002}
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY18465%27 HTTP/1.1" 200 None
2026-03-29 10:35:44 [auto1.de] INFO: Saving data for YY18465: {'auction_closing_time': 1774885076.0, 'created_time': 1774637241.676485, 'last_price_update_time': 1774780544.72953}
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY18465') HTTP/1.1" 204 0
2026-03-29 10:35:44 [auto1.de] INFO: Found listing with ID: NW73502
2026-03-29 10:35:44 [auto1.de] INFO: Found listing with ID: BV67523
2026-03-29 10:35:44 [auto1.de] INFO: Found listing with ID: NW01649
2026-03-29 10:35:44 [auto1.de] INFO: Found listing with ID: ZX12399
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX12399%27 HTTP/1.1" 200 None
2026-03-29 10:35:44 [auto1.de] INFO: Scrape type for ZX12399: 2
2026-03-29 10:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcee13e3-2f6e-55e7-ba72-3de35cdc2b6a with identifier: ZX12399
2026-03-29 10:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcee13e3-2f6e-55e7-ba72-3de35cdc2b6a with scrape type 2
2026-03-29 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcee13e3-2f6e-55e7-ba72-3de35cdc2b6a with scrape type 2
2026-03-29 10:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fcee13e3-2f6e-55e7-ba72-3de35cdc2b6a, identifier: ZX12399
2026-03-29 10:35:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:44 [auto1.de] INFO: Found listing with ID: VC28435
2026-03-29 10:35:44 [auto1.de] INFO: Found listing with ID: HJ76482
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ76482%27 HTTP/1.1" 200 None
2026-03-29 10:35:44 [auto1.de] INFO: Scrape type for HJ76482: 2
2026-03-29 10:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2eacd36-37c1-5b9f-a049-3f8ef88329ff with identifier: HJ76482
2026-03-29 10:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2eacd36-37c1-5b9f-a049-3f8ef88329ff with scrape type 2
2026-03-29 10:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2eacd36-37c1-5b9f-a049-3f8ef88329ff with scrape type 2
2026-03-29 10:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2eacd36-37c1-5b9f-a049-3f8ef88329ff, identifier: HJ76482
2026-03-29 10:35:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fcee13e3-2f6e-55e7-ba72-3de35cdc2b6a with identifier: ZX12399
2026-03-29 10:35:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fcee13e3-2f6e-55e7-ba72-3de35cdc2b6a with identifier: ZX12399
2026-03-29 10:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fcee13e3-2f6e-55e7-ba72-3de35cdc2b6a with identifier: ZX12399 to the API
2026-03-29 10:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 103,
 'expiration_date': '2026-03-30T15:04:01Z',
 'fuel_type': 'petrol',
 'id': 'fcee13e3-2f6e-55e7-ba72-3de35cdc2b6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX12399',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 49296,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-12-19',
 'seller_name': None,
 'title': 'Ford Puma 1.6 Futura2',
 'transmission': 'manual',
 'trim': 'Futura2',
 'year': 2001}
2026-03-29 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX12399%27 HTTP/1.1" 200 None
2026-03-29 10:35:45 [auto1.de] INFO: Saving data for ZX12399: {'auction_closing_time': 1774883041.0, 'created_time': 1773428979.902194, 'last_price_update_time': 1774780545.281008}
2026-03-29 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZX12399') HTTP/1.1" 204 0
2026-03-29 10:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2eacd36-37c1-5b9f-a049-3f8ef88329ff with identifier: HJ76482
2026-03-29 10:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2eacd36-37c1-5b9f-a049-3f8ef88329ff with identifier: HJ76482
2026-03-29 10:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2eacd36-37c1-5b9f-a049-3f8ef88329ff with identifier: HJ76482 to the API
2026-03-29 10:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:43:55Z',
 'fuel_type': 'petrol',
 'id': 'e2eacd36-37c1-5b9f-a049-3f8ef88329ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ76482',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 198563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-12-05',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2000}
2026-03-29 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ76482%27 HTTP/1.1" 200 None
2026-03-29 10:35:45 [auto1.de] INFO: Saving data for HJ76482: {'auction_closing_time': 1774885435.0, 'created_time': 1773688187.07017, 'last_price_update_time': 1774780545.738037}
2026-03-29 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ76482') HTTP/1.1" 204 0
2026-03-29 10:35:45 [auto1.de] INFO: Found listing with ID: SN44411
2026-03-29 10:35:45 [auto1.de] INFO: Found listing with ID: BJ40023
2026-03-29 10:35:45 [auto1.de] INFO: Found listing with ID: GM20688
2026-03-29 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM20688%27 HTTP/1.1" 200 None
2026-03-29 10:35:45 [auto1.de] INFO: Scrape type for GM20688: 2
2026-03-29 10:35:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe96e208-c03b-5110-97d0-620641e91948 with identifier: GM20688
2026-03-29 10:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe96e208-c03b-5110-97d0-620641e91948 with scrape type 2
2026-03-29 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe96e208-c03b-5110-97d0-620641e91948 with scrape type 2
2026-03-29 10:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe96e208-c03b-5110-97d0-620641e91948, identifier: GM20688
2026-03-29 10:35:45 [auto1.de] INFO: Found listing with ID: KP69989
2026-03-29 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP69989%27 HTTP/1.1" 200 None
2026-03-29 10:35:45 [auto1.de] INFO: Scrape type for KP69989: 2
2026-03-29 10:35:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c666ffb-3ce2-5dbc-b807-029abfb5e8e3 with identifier: KP69989
2026-03-29 10:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c666ffb-3ce2-5dbc-b807-029abfb5e8e3 with scrape type 2
2026-03-29 10:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c666ffb-3ce2-5dbc-b807-029abfb5e8e3 with scrape type 2
2026-03-29 10:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c666ffb-3ce2-5dbc-b807-029abfb5e8e3, identifier: KP69989
2026-03-29 10:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe96e208-c03b-5110-97d0-620641e91948 with identifier: GM20688
2026-03-29 10:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe96e208-c03b-5110-97d0-620641e91948 with identifier: GM20688
2026-03-29 10:35:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe96e208-c03b-5110-97d0-620641e91948 with identifier: GM20688 to the API
2026-03-29 10:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:23:33Z',
 'fuel_type': 'diesel',
 'id': 'fe96e208-c03b-5110-97d0-620641e91948',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM20688',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 91967,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-23',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Trendline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Trendline BlueMotion',
 'year': 2019}
2026-03-29 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM20688%27 HTTP/1.1" 200 None
2026-03-29 10:35:46 [auto1.de] INFO: Saving data for GM20688: {'auction_closing_time': 1774884213.0, 'created_time': 1774465941.412545, 'last_price_update_time': 1774780546.460114}
2026-03-29 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM20688') HTTP/1.1" 204 0
2026-03-29 10:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c666ffb-3ce2-5dbc-b807-029abfb5e8e3 with identifier: KP69989
2026-03-29 10:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c666ffb-3ce2-5dbc-b807-029abfb5e8e3 with identifier: KP69989
2026-03-29 10:35:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c666ffb-3ce2-5dbc-b807-029abfb5e8e3 with identifier: KP69989 to the API
2026-03-29 10:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 58,
 'expiration_date': '2026-03-30T15:47:45Z',
 'fuel_type': 'petrol',
 'id': '0c666ffb-3ce2-5dbc-b807-029abfb5e8e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP69989',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 81971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-03-31',
 'seller_name': None,
 'title': 'Renault Twingo 1.2',
 'transmission': 'automatic',
 'trim': '',
 'year': 1998}
2026-03-29 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP69989%27 HTTP/1.1" 200 None
2026-03-29 10:35:46 [auto1.de] INFO: Saving data for KP69989: {'auction_closing_time': 1774885665.0, 'created_time': 1774378910.712866, 'last_price_update_time': 1774780546.832924}
2026-03-29 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP69989') HTTP/1.1" 204 0
2026-03-29 10:35:46 [auto1.de] INFO: Found listing with ID: HA10005
2026-03-29 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA10005%27 HTTP/1.1" 200 None
2026-03-29 10:35:46 [auto1.de] INFO: Scrape type for HA10005: 2
2026-03-29 10:35:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6261b8f0-3aab-5dd8-a6e8-e7dde4010f8d with identifier: HA10005
2026-03-29 10:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6261b8f0-3aab-5dd8-a6e8-e7dde4010f8d with scrape type 2
2026-03-29 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6261b8f0-3aab-5dd8-a6e8-e7dde4010f8d with scrape type 2
2026-03-29 10:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6261b8f0-3aab-5dd8-a6e8-e7dde4010f8d, identifier: HA10005
2026-03-29 10:35:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VY63295/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:46 [auto1.de] INFO: Found listing with ID: GT35568
2026-03-29 10:35:46 [auto1.de] INFO: Found listing with ID: TJ90592
2026-03-29 10:35:46 [auto1.de] INFO: Found listing with ID: ZS29776
2026-03-29 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS29776%27 HTTP/1.1" 200 None
2026-03-29 10:35:46 [auto1.de] INFO: Scrape type for ZS29776: 2
2026-03-29 10:35:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e82f3c59-c09d-54e9-9257-080d6ecf23c7 with identifier: ZS29776
2026-03-29 10:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e82f3c59-c09d-54e9-9257-080d6ecf23c7 with scrape type 2
2026-03-29 10:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e82f3c59-c09d-54e9-9257-080d6ecf23c7 with scrape type 2
2026-03-29 10:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e82f3c59-c09d-54e9-9257-080d6ecf23c7, identifier: ZS29776
2026-03-29 10:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6261b8f0-3aab-5dd8-a6e8-e7dde4010f8d with identifier: HA10005
2026-03-29 10:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6261b8f0-3aab-5dd8-a6e8-e7dde4010f8d with identifier: HA10005
2026-03-29 10:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6261b8f0-3aab-5dd8-a6e8-e7dde4010f8d with identifier: HA10005 to the API
2026-03-29 10:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:32:09Z',
 'fuel_type': 'petrol',
 'id': '6261b8f0-3aab-5dd8-a6e8-e7dde4010f8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA10005',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '307',
 'odometer': 118258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-10-07',
 'seller_name': None,
 'title': 'Peugeot 307 1.6 Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2003}
2026-03-29 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA10005%27 HTTP/1.1" 200 None
2026-03-29 10:35:47 [auto1.de] INFO: Saving data for HA10005: {'auction_closing_time': 1774884729.0, 'created_time': 1773305910.737394, 'last_price_update_time': 1774780547.468145}
2026-03-29 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA10005') HTTP/1.1" 204 0
2026-03-29 10:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e82f3c59-c09d-54e9-9257-080d6ecf23c7 with identifier: ZS29776
2026-03-29 10:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e82f3c59-c09d-54e9-9257-080d6ecf23c7 with identifier: ZS29776
2026-03-29 10:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e82f3c59-c09d-54e9-9257-080d6ecf23c7 with identifier: ZS29776 to the API
2026-03-29 10:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 55,
 'expiration_date': '2026-03-30T15:17:56Z',
 'fuel_type': 'petrol',
 'id': 'e82f3c59-c09d-54e9-9257-080d6ecf23c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS29776',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 76860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-09-15',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2',
 'transmission': 'manual',
 'trim': '',
 'year': 2002}
2026-03-29 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS29776%27 HTTP/1.1" 200 None
2026-03-29 10:35:47 [auto1.de] INFO: Saving data for ZS29776: {'auction_closing_time': 1774883876.0, 'created_time': 1773741413.3073559, 'last_price_update_time': 1774780547.845207}
2026-03-29 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS29776') HTTP/1.1" 204 0
2026-03-29 10:35:47 [auto1.de] INFO: Found listing with ID: VR35896
2026-03-29 10:35:47 [auto1.de] INFO: Found listing with ID: CZ25681
2026-03-29 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ25681%27 HTTP/1.1" 200 None
2026-03-29 10:35:47 [auto1.de] INFO: Scrape type for CZ25681: 2
2026-03-29 10:35:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75c6a4e1-64d4-5971-b744-0b4b926dc513 with identifier: CZ25681
2026-03-29 10:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75c6a4e1-64d4-5971-b744-0b4b926dc513 with scrape type 2
2026-03-29 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75c6a4e1-64d4-5971-b744-0b4b926dc513 with scrape type 2
2026-03-29 10:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75c6a4e1-64d4-5971-b744-0b4b926dc513, identifier: CZ25681
2026-03-29 10:35:47 [auto1.de] INFO: Found listing with ID: PJ98033
2026-03-29 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ98033%27 HTTP/1.1" 200 None
2026-03-29 10:35:47 [auto1.de] INFO: Scrape type for PJ98033: 2
2026-03-29 10:35:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc2378dc-495d-5342-93ef-4c9f70d3e4f5 with identifier: PJ98033
2026-03-29 10:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc2378dc-495d-5342-93ef-4c9f70d3e4f5 with scrape type 2
2026-03-29 10:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc2378dc-495d-5342-93ef-4c9f70d3e4f5 with scrape type 2
2026-03-29 10:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc2378dc-495d-5342-93ef-4c9f70d3e4f5, identifier: PJ98033
2026-03-29 10:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75c6a4e1-64d4-5971-b744-0b4b926dc513 with identifier: CZ25681
2026-03-29 10:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75c6a4e1-64d4-5971-b744-0b4b926dc513 with identifier: CZ25681
2026-03-29 10:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75c6a4e1-64d4-5971-b744-0b4b926dc513 with identifier: CZ25681 to the API
2026-03-29 10:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:53:30Z',
 'fuel_type': 'diesel',
 'id': '75c6a4e1-64d4-5971-b744-0b4b926dc513',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ25681',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 116472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-17',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi EcoBlue ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2018}
2026-03-29 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ25681%27 HTTP/1.1" 200 None
2026-03-29 10:35:48 [auto1.de] INFO: Saving data for CZ25681: {'auction_closing_time': 1774886010.0, 'created_time': 1773946054.350922, 'last_price_update_time': 1774780548.419346}
2026-03-29 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ25681') HTTP/1.1" 204 0
2026-03-29 10:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc2378dc-495d-5342-93ef-4c9f70d3e4f5 with identifier: PJ98033
2026-03-29 10:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc2378dc-495d-5342-93ef-4c9f70d3e4f5 with identifier: PJ98033
2026-03-29 10:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc2378dc-495d-5342-93ef-4c9f70d3e4f5 with identifier: PJ98033 to the API
2026-03-29 10:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:24:37Z',
 'fuel_type': 'petrol',
 'id': 'bc2378dc-495d-5342-93ef-4c9f70d3e4f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ98033',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 177203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-25',
 'seller_name': None,
 'title': 'Jaguar E-Pace P300 R-Dynamic HSE AWD',
 'transmission': 'automatic',
 'trim': 'R-Dynamic HSE AWD',
 'year': 2018}
2026-03-29 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ98033%27 HTTP/1.1" 200 None
2026-03-29 10:35:48 [auto1.de] INFO: Saving data for PJ98033: {'auction_closing_time': 1774884277.0, 'created_time': 1774551471.029718, 'last_price_update_time': 1774780548.843958}
2026-03-29 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ98033') HTTP/1.1" 204 0
2026-03-29 10:35:48 [auto1.de] INFO: Found listing with ID: CG76921
2026-03-29 10:35:48 [auto1.de] INFO: Found listing with ID: JT14161
2026-03-29 10:35:48 [auto1.de] INFO: Found listing with ID: GX28379
2026-03-29 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX28379%27 HTTP/1.1" 200 None
2026-03-29 10:35:48 [auto1.de] INFO: Scrape type for GX28379: 2
2026-03-29 10:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f16c2869-a320-5d78-8ff0-a08e0efa122f with identifier: GX28379
2026-03-29 10:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f16c2869-a320-5d78-8ff0-a08e0efa122f with scrape type 2
2026-03-29 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f16c2869-a320-5d78-8ff0-a08e0efa122f with scrape type 2
2026-03-29 10:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f16c2869-a320-5d78-8ff0-a08e0efa122f, identifier: GX28379
2026-03-29 10:35:48 [auto1.de] INFO: Found listing with ID: CV58900
2026-03-29 10:35:48 [auto1.de] INFO: Found listing with ID: RG53469
2026-03-29 10:35:48 [auto1.de] INFO: Found listing with ID: AT97457
2026-03-29 10:35:48 [auto1.de] INFO: Found listing with ID: DS41181
2026-03-29 10:35:48 [auto1.de] INFO: Found listing with ID: WY61426
2026-03-29 10:35:48 [auto1.de] INFO: Found listing with ID: ZA83090
2026-03-29 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA83090%27 HTTP/1.1" 200 None
2026-03-29 10:35:48 [auto1.de] INFO: Scrape type for ZA83090: 2
2026-03-29 10:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1c7e94e-08c3-5514-9f35-38d9864e25cf with identifier: ZA83090
2026-03-29 10:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1c7e94e-08c3-5514-9f35-38d9864e25cf with scrape type 2
2026-03-29 10:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1c7e94e-08c3-5514-9f35-38d9864e25cf with scrape type 2
2026-03-29 10:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e1c7e94e-08c3-5514-9f35-38d9864e25cf, identifier: ZA83090
2026-03-29 10:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f16c2869-a320-5d78-8ff0-a08e0efa122f with identifier: GX28379
2026-03-29 10:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f16c2869-a320-5d78-8ff0-a08e0efa122f with identifier: GX28379
2026-03-29 10:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f16c2869-a320-5d78-8ff0-a08e0efa122f with identifier: GX28379 to the API
2026-03-29 10:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:13:12Z',
 'fuel_type': 'petrol',
 'id': 'f16c2869-a320-5d78-8ff0-a08e0efa122f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX28379',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'MPV',
 'odometer': 336066,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-12-26',
 'seller_name': None,
 'title': 'Mazda MPV 2.0 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2001}
2026-03-29 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX28379%27 HTTP/1.1" 200 None
2026-03-29 10:35:49 [auto1.de] INFO: Saving data for GX28379: {'auction_closing_time': 1774883592.0, 'created_time': 1774034569.837588, 'last_price_update_time': 1774780549.45621}
2026-03-29 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX28379') HTTP/1.1" 204 0
2026-03-29 10:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e1c7e94e-08c3-5514-9f35-38d9864e25cf with identifier: ZA83090
2026-03-29 10:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e1c7e94e-08c3-5514-9f35-38d9864e25cf with identifier: ZA83090
2026-03-29 10:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e1c7e94e-08c3-5514-9f35-38d9864e25cf with identifier: ZA83090 to the API
2026-03-29 10:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-30T15:19:37Z',
 'fuel_type': 'diesel',
 'id': 'e1c7e94e-08c3-5514-9f35-38d9864e25cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA83090',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 177886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-23',
 'seller_name': None,
 'title': 'Audi A4 50 TDI quattro sport',
 'transmission': 'automatic',
 'trim': 'quattro sport',
 'year': 2019}
2026-03-29 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA83090%27 HTTP/1.1" 200 None
2026-03-29 10:35:49 [auto1.de] INFO: Saving data for ZA83090: {'auction_closing_time': 1774883977.0, 'created_time': 1774550659.221894, 'last_price_update_time': 1774780549.781687}
2026-03-29 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA83090') HTTP/1.1" 204 0
2026-03-29 10:35:49 [auto1.de] INFO: Found listing with ID: LN95655
2026-03-29 10:35:49 [auto1.de] INFO: Found listing with ID: WF02803
2026-03-29 10:35:49 [auto1.de] INFO: Found listing with ID: UH31359
2026-03-29 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH31359%27 HTTP/1.1" 200 None
2026-03-29 10:35:49 [auto1.de] INFO: Scrape type for UH31359: 1
2026-03-29 10:35:49 [auto1.de] INFO: Found listing with ID: BV92050
2026-03-29 10:35:49 [auto1.de] INFO: Found listing with ID: UL88623
2026-03-29 10:35:49 [auto1.de] INFO: Found listing with ID: NX62884
2026-03-29 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX62884%27 HTTP/1.1" 200 None
2026-03-29 10:35:49 [auto1.de] INFO: Scrape type for NX62884: 2
2026-03-29 10:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99027328-199d-57e2-9c07-22e90e160cfc with identifier: NX62884
2026-03-29 10:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99027328-199d-57e2-9c07-22e90e160cfc with scrape type 2
2026-03-29 10:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99027328-199d-57e2-9c07-22e90e160cfc with scrape type 2
2026-03-29 10:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99027328-199d-57e2-9c07-22e90e160cfc, identifier: NX62884
2026-03-29 10:35:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99027328-199d-57e2-9c07-22e90e160cfc with identifier: NX62884
2026-03-29 10:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99027328-199d-57e2-9c07-22e90e160cfc with identifier: NX62884
2026-03-29 10:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99027328-199d-57e2-9c07-22e90e160cfc with identifier: NX62884 to the API
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:19:05Z',
 'fuel_type': 'petrol',
 'id': '99027328-199d-57e2-9c07-22e90e160cfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX62884',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 9733,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-19',
 'seller_name': None,
 'title': 'Hyundai i30 1.0 TGDI Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2024}
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX62884%27 HTTP/1.1" 200 None
2026-03-29 10:35:50 [auto1.de] INFO: Saving data for NX62884: {'auction_closing_time': 1774883945.0, 'created_time': 1774379409.849261, 'last_price_update_time': 1774780550.260694}
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX62884') HTTP/1.1" 204 0
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: LG46226
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG46226%27 HTTP/1.1" 200 None
2026-03-29 10:35:50 [auto1.de] INFO: Scrape type for LG46226: 2
2026-03-29 10:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c37280a7-dab6-5bee-be3f-dd9a168eb6ba with identifier: LG46226
2026-03-29 10:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c37280a7-dab6-5bee-be3f-dd9a168eb6ba with scrape type 2
2026-03-29 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c37280a7-dab6-5bee-be3f-dd9a168eb6ba with scrape type 2
2026-03-29 10:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c37280a7-dab6-5bee-be3f-dd9a168eb6ba, identifier: LG46226
2026-03-29 10:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:50 [auto1.de] INFO: Found listing with ID: JJ76956
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ76956%27 HTTP/1.1" 200 None
2026-03-29 10:35:50 [auto1.de] INFO: Scrape type for JJ76956: 2
2026-03-29 10:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f6f51da-f8ba-5740-90d2-409199f2d9fb with identifier: JJ76956
2026-03-29 10:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f6f51da-f8ba-5740-90d2-409199f2d9fb with scrape type 2
2026-03-29 10:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f6f51da-f8ba-5740-90d2-409199f2d9fb with scrape type 2
2026-03-29 10:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f6f51da-f8ba-5740-90d2-409199f2d9fb, identifier: JJ76956
2026-03-29 10:35:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c37280a7-dab6-5bee-be3f-dd9a168eb6ba with identifier: LG46226
2026-03-29 10:35:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c37280a7-dab6-5bee-be3f-dd9a168eb6ba with identifier: LG46226
2026-03-29 10:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c37280a7-dab6-5bee-be3f-dd9a168eb6ba with identifier: LG46226 to the API
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:17:17Z',
 'fuel_type': 'diesel',
 'id': 'c37280a7-dab6-5bee-be3f-dd9a168eb6ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG46226',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 68715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-03',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Style 4x4',
 'transmission': 'automatic',
 'trim': 'Style 4x4',
 'year': 2017}
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG46226%27 HTTP/1.1" 200 None
2026-03-29 10:35:50 [auto1.de] INFO: Saving data for LG46226: {'auction_closing_time': 1774883837.0, 'created_time': 1774031994.76186, 'last_price_update_time': 1774780550.925846}
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG46226') HTTP/1.1" 204 0
2026-03-29 10:35:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f6f51da-f8ba-5740-90d2-409199f2d9fb with identifier: JJ76956
2026-03-29 10:35:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f6f51da-f8ba-5740-90d2-409199f2d9fb with identifier: JJ76956
2026-03-29 10:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f6f51da-f8ba-5740-90d2-409199f2d9fb with identifier: JJ76956 to the API
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-30T15:53:59Z',
 'fuel_type': 'petrol',
 'id': '0f6f51da-f8ba-5740-90d2-409199f2d9fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ76956',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Grande Punto',
 'odometer': 153045,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-25',
 'seller_name': None,
 'title': 'Fiat Grande Punto 1.4 Start',
 'transmission': 'manual',
 'trim': 'Start',
 'year': 2008}
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ76956%27 HTTP/1.1" 200 None
2026-03-29 10:35:51 [auto1.de] INFO: Saving data for JJ76956: {'auction_closing_time': 1774886039.0, 'created_time': 1773946531.616555, 'last_price_update_time': 1774780551.267332}
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ76956') HTTP/1.1" 204 0
2026-03-29 10:35:51 [auto1.de] INFO: Found listing with ID: BE23086
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE23086%27 HTTP/1.1" 200 None
2026-03-29 10:35:51 [auto1.de] INFO: Scrape type for BE23086: 1
2026-03-29 10:35:51 [auto1.de] INFO: Found listing with ID: HP19661
2026-03-29 10:35:51 [auto1.de] INFO: Found listing with ID: GN33586
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN33586%27 HTTP/1.1" 200 None
2026-03-29 10:35:51 [auto1.de] INFO: Scrape type for GN33586: 2
2026-03-29 10:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c5019e3-a1a7-5d7e-8d08-af133b5b7ae8 with identifier: GN33586
2026-03-29 10:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c5019e3-a1a7-5d7e-8d08-af133b5b7ae8 with scrape type 2
2026-03-29 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c5019e3-a1a7-5d7e-8d08-af133b5b7ae8 with scrape type 2
2026-03-29 10:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3c5019e3-a1a7-5d7e-8d08-af133b5b7ae8, identifier: GN33586
2026-03-29 10:35:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:51 [auto1.de] INFO: Channel: 24h | Page: 4 | totalHits: 6726 | hits on page: 40
2026-03-29 10:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3c5019e3-a1a7-5d7e-8d08-af133b5b7ae8 with identifier: GN33586
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-29 10:35:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 10:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3c5019e3-a1a7-5d7e-8d08-af133b5b7ae8 with identifier: GN33586
2026-03-29 10:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3c5019e3-a1a7-5d7e-8d08-af133b5b7ae8 with identifier: GN33586 to the API
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:06:57Z',
 'fuel_type': 'gas',
 'id': '3c5019e3-a1a7-5d7e-8d08-af133b5b7ae8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN33586',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 296960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-25',
 'seller_name': None,
 'title': 'Opel Zafira 1.6 Turbo Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2009}
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN33586%27 HTTP/1.1" 200 None
2026-03-29 10:35:51 [auto1.de] INFO: Saving data for GN33586: {'auction_closing_time': 1774883217.0, 'created_time': 1773383100.903011, 'last_price_update_time': 1774780551.869491}
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GN33586') HTTP/1.1" 204 0
2026-03-29 10:35:51 [auto1.de] INFO: Found listing with ID: FA69463
2026-03-29 10:35:51 [auto1.de] INFO: Found listing with ID: WG22836
2026-03-29 10:35:51 [auto1.de] INFO: Found listing with ID: HN88809
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN88809%27 HTTP/1.1" 200 None
2026-03-29 10:35:51 [auto1.de] INFO: Scrape type for HN88809: 2
2026-03-29 10:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28e5ff8c-3507-5cbe-b1ca-c45f51b40e24 with identifier: HN88809
2026-03-29 10:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28e5ff8c-3507-5cbe-b1ca-c45f51b40e24 with scrape type 2
2026-03-29 10:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28e5ff8c-3507-5cbe-b1ca-c45f51b40e24 with scrape type 2
2026-03-29 10:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28e5ff8c-3507-5cbe-b1ca-c45f51b40e24, identifier: HN88809
2026-03-29 10:35:52 [auto1.de] INFO: Found listing with ID: VN24673
2026-03-29 10:35:52 [auto1.de] INFO: Found listing with ID: RL83760
2026-03-29 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL83760%27 HTTP/1.1" 200 None
2026-03-29 10:35:52 [auto1.de] INFO: Scrape type for RL83760: 2
2026-03-29 10:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5db0cf00-68e7-5bde-95f2-74fb38274bcb with identifier: RL83760
2026-03-29 10:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5db0cf00-68e7-5bde-95f2-74fb38274bcb with scrape type 2
2026-03-29 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5db0cf00-68e7-5bde-95f2-74fb38274bcb with scrape type 2
2026-03-29 10:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5db0cf00-68e7-5bde-95f2-74fb38274bcb, identifier: RL83760
2026-03-29 10:35:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28e5ff8c-3507-5cbe-b1ca-c45f51b40e24 with identifier: HN88809
2026-03-29 10:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28e5ff8c-3507-5cbe-b1ca-c45f51b40e24 with identifier: HN88809
2026-03-29 10:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28e5ff8c-3507-5cbe-b1ca-c45f51b40e24 with identifier: HN88809 to the API
2026-03-29 10:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:23:25Z',
 'fuel_type': 'petrol',
 'id': '28e5ff8c-3507-5cbe-b1ca-c45f51b40e24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN88809',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 181761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-05-23',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2005}
2026-03-29 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN88809%27 HTTP/1.1" 200 None
2026-03-29 10:35:52 [auto1.de] INFO: Saving data for HN88809: {'auction_closing_time': 1774884205.0, 'created_time': 1773772726.470891, 'last_price_update_time': 1774780552.530554}
2026-03-29 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HN88809') HTTP/1.1" 204 0
2026-03-29 10:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5db0cf00-68e7-5bde-95f2-74fb38274bcb with identifier: RL83760
2026-03-29 10:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5db0cf00-68e7-5bde-95f2-74fb38274bcb with identifier: RL83760
2026-03-29 10:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5db0cf00-68e7-5bde-95f2-74fb38274bcb with identifier: RL83760 to the API
2026-03-29 10:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:41:36Z',
 'fuel_type': 'petrol',
 'id': '5db0cf00-68e7-5bde-95f2-74fb38274bcb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL83760',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Logo',
 'odometer': 81796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-03-21',
 'seller_name': None,
 'title': 'Honda Logo 1.3',
 'transmission': 'automatic',
 'trim': '',
 'year': 1999}
2026-03-29 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL83760%27 HTTP/1.1" 200 None
2026-03-29 10:35:52 [auto1.de] INFO: Saving data for RL83760: {'auction_closing_time': 1774885296.0, 'created_time': 1774550724.667173, 'last_price_update_time': 1774780552.898249}
2026-03-29 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RL83760') HTTP/1.1" 204 0
2026-03-29 10:35:52 [auto1.de] INFO: Found listing with ID: NV36056
2026-03-29 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV36056%27 HTTP/1.1" 200 None
2026-03-29 10:35:52 [auto1.de] INFO: Scrape type for NV36056: 2
2026-03-29 10:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e29c92b4-407f-5012-b4d4-a7f7d95fb220 with identifier: NV36056
2026-03-29 10:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e29c92b4-407f-5012-b4d4-a7f7d95fb220 with scrape type 2
2026-03-29 10:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e29c92b4-407f-5012-b4d4-a7f7d95fb220 with scrape type 2
2026-03-29 10:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e29c92b4-407f-5012-b4d4-a7f7d95fb220, identifier: NV36056
2026-03-29 10:35:53 [auto1.de] INFO: Found listing with ID: UY63030
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY63030%27 HTTP/1.1" 200 None
2026-03-29 10:35:53 [auto1.de] INFO: Scrape type for UY63030: 2
2026-03-29 10:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23558bdd-3615-50fa-896c-1827cc61a4dd with identifier: UY63030
2026-03-29 10:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23558bdd-3615-50fa-896c-1827cc61a4dd with scrape type 2
2026-03-29 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23558bdd-3615-50fa-896c-1827cc61a4dd with scrape type 2
2026-03-29 10:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23558bdd-3615-50fa-896c-1827cc61a4dd, identifier: UY63030
2026-03-29 10:35:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e29c92b4-407f-5012-b4d4-a7f7d95fb220 with identifier: NV36056
2026-03-29 10:35:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e29c92b4-407f-5012-b4d4-a7f7d95fb220 with identifier: NV36056
2026-03-29 10:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e29c92b4-407f-5012-b4d4-a7f7d95fb220 with identifier: NV36056 to the API
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:01:00Z',
 'fuel_type': 'diesel',
 'id': 'e29c92b4-407f-5012-b4d4-a7f7d95fb220',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV36056',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 397835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-20',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2009}
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV36056%27 HTTP/1.1" 200 None
2026-03-29 10:35:53 [auto1.de] INFO: Saving data for NV36056: {'auction_closing_time': 1774882860.0, 'created_time': 1773227463.856825, 'last_price_update_time': 1774780553.479153}
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV36056') HTTP/1.1" 204 0
2026-03-29 10:35:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23558bdd-3615-50fa-896c-1827cc61a4dd with identifier: UY63030
2026-03-29 10:35:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23558bdd-3615-50fa-896c-1827cc61a4dd with identifier: UY63030
2026-03-29 10:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23558bdd-3615-50fa-896c-1827cc61a4dd with identifier: UY63030 to the API
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:56:13Z',
 'fuel_type': 'diesel',
 'id': '23558bdd-3615-50fa-896c-1827cc61a4dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY63030',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 210950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-06-30',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY63030%27 HTTP/1.1" 200 None
2026-03-29 10:35:53 [auto1.de] INFO: Saving data for UY63030: {'auction_closing_time': 1774886173.0, 'created_time': 1773427828.857015, 'last_price_update_time': 1774780553.895799}
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY63030') HTTP/1.1" 204 0
2026-03-29 10:35:53 [auto1.de] INFO: Found listing with ID: GF37615
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF37615%27 HTTP/1.1" 200 None
2026-03-29 10:35:53 [auto1.de] INFO: Scrape type for GF37615: 2
2026-03-29 10:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d6191c1-46f5-5ec3-b0c6-0ec90c7fadf5 with identifier: GF37615
2026-03-29 10:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d6191c1-46f5-5ec3-b0c6-0ec90c7fadf5 with scrape type 2
2026-03-29 10:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d6191c1-46f5-5ec3-b0c6-0ec90c7fadf5 with scrape type 2
2026-03-29 10:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d6191c1-46f5-5ec3-b0c6-0ec90c7fadf5, identifier: GF37615
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: HH17921
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH17921%27 HTTP/1.1" 200 None
2026-03-29 10:35:54 [auto1.de] INFO: Scrape type for HH17921: 2
2026-03-29 10:35:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08c8065f-a223-56a0-9f34-35213e8da58c with identifier: HH17921
2026-03-29 10:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08c8065f-a223-56a0-9f34-35213e8da58c with scrape type 2
2026-03-29 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08c8065f-a223-56a0-9f34-35213e8da58c with scrape type 2
2026-03-29 10:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08c8065f-a223-56a0-9f34-35213e8da58c, identifier: HH17921
2026-03-29 10:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d6191c1-46f5-5ec3-b0c6-0ec90c7fadf5 with identifier: GF37615
2026-03-29 10:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d6191c1-46f5-5ec3-b0c6-0ec90c7fadf5 with identifier: GF37615
2026-03-29 10:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d6191c1-46f5-5ec3-b0c6-0ec90c7fadf5 with identifier: GF37615 to the API
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:52:53Z',
 'fuel_type': 'petrol',
 'id': '8d6191c1-46f5-5ec3-b0c6-0ec90c7fadf5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF37615',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 126115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-21',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2016}
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF37615%27 HTTP/1.1" 200 None
2026-03-29 10:35:54 [auto1.de] INFO: Saving data for GF37615: {'auction_closing_time': 1774885973.0, 'created_time': 1773224150.645807, 'last_price_update_time': 1774780554.528375}
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF37615') HTTP/1.1" 204 0
2026-03-29 10:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08c8065f-a223-56a0-9f34-35213e8da58c with identifier: HH17921
2026-03-29 10:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08c8065f-a223-56a0-9f34-35213e8da58c with identifier: HH17921
2026-03-29 10:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08c8065f-a223-56a0-9f34-35213e8da58c with identifier: HH17921 to the API
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:01:30Z',
 'fuel_type': 'diesel',
 'id': '08c8065f-a223-56a0-9f34-35213e8da58c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH17921',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 59568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-25',
 'seller_name': None,
 'title': 'Peugeot 3008 2.0 Blue-HDi Business Pack',
 'transmission': 'manual',
 'trim': 'Business Pack',
 'year': 2015}
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH17921%27 HTTP/1.1" 200 None
2026-03-29 10:35:54 [auto1.de] INFO: Saving data for HH17921: {'auction_closing_time': 1774882890.0, 'created_time': 1774550658.901572, 'last_price_update_time': 1774780554.893515}
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HH17921') HTTP/1.1" 204 0
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: VF27943
2026-03-29 10:35:54 [auto1.de] INFO: Found listing with ID: EK20296
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK20296%27 HTTP/1.1" 200 None
2026-03-29 10:35:54 [auto1.de] INFO: Scrape type for EK20296: 2
2026-03-29 10:35:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d01c62f-7421-5962-9d8a-b284bd9fb1b1 with identifier: EK20296
2026-03-29 10:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d01c62f-7421-5962-9d8a-b284bd9fb1b1 with scrape type 2
2026-03-29 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d01c62f-7421-5962-9d8a-b284bd9fb1b1 with scrape type 2
2026-03-29 10:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d01c62f-7421-5962-9d8a-b284bd9fb1b1, identifier: EK20296
2026-03-29 10:35:55 [auto1.de] INFO: Found listing with ID: ZY88037
2026-03-29 10:35:55 [auto1.de] INFO: Found listing with ID: MZ37823
2026-03-29 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ37823%27 HTTP/1.1" 200 None
2026-03-29 10:35:55 [auto1.de] INFO: Scrape type for MZ37823: 1
2026-03-29 10:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d01c62f-7421-5962-9d8a-b284bd9fb1b1 with identifier: EK20296
2026-03-29 10:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d01c62f-7421-5962-9d8a-b284bd9fb1b1 with identifier: EK20296
2026-03-29 10:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d01c62f-7421-5962-9d8a-b284bd9fb1b1 with identifier: EK20296 to the API
2026-03-29 10:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:56:24Z',
 'fuel_type': 'petrol',
 'id': '9d01c62f-7421-5962-9d8a-b284bd9fb1b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK20296',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '307',
 'odometer': 132050,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-07-25',
 'seller_name': None,
 'title': 'Peugeot 307 1.4 XR',
 'transmission': 'manual',
 'trim': 'XR',
 'year': 2002}
2026-03-29 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK20296%27 HTTP/1.1" 200 None
2026-03-29 10:35:55 [auto1.de] INFO: Saving data for EK20296: {'auction_closing_time': 1774886184.0, 'created_time': 1774637780.509224, 'last_price_update_time': 1774780555.338037}
2026-03-29 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EK20296') HTTP/1.1" 204 0
2026-03-29 10:35:55 [auto1.de] INFO: Found listing with ID: AF05413
2026-03-29 10:35:55 [auto1.de] INFO: Found listing with ID: MC98570
2026-03-29 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC98570%27 HTTP/1.1" 200 None
2026-03-29 10:35:55 [auto1.de] INFO: Scrape type for MC98570: 2
2026-03-29 10:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebfd9360-84eb-5a41-83e5-cf0d5465d616 with identifier: MC98570
2026-03-29 10:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebfd9360-84eb-5a41-83e5-cf0d5465d616 with scrape type 2
2026-03-29 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebfd9360-84eb-5a41-83e5-cf0d5465d616 with scrape type 2
2026-03-29 10:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ebfd9360-84eb-5a41-83e5-cf0d5465d616, identifier: MC98570
2026-03-29 10:35:55 [auto1.de] INFO: Found listing with ID: NC19407
2026-03-29 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC19407%27 HTTP/1.1" 200 None
2026-03-29 10:35:55 [auto1.de] INFO: Scrape type for NC19407: 2
2026-03-29 10:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2eaa094c-fb8a-569f-b03b-98a5f3ed76ee with identifier: NC19407
2026-03-29 10:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2eaa094c-fb8a-569f-b03b-98a5f3ed76ee with scrape type 2
2026-03-29 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2eaa094c-fb8a-569f-b03b-98a5f3ed76ee with scrape type 2
2026-03-29 10:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2eaa094c-fb8a-569f-b03b-98a5f3ed76ee, identifier: NC19407
2026-03-29 10:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ebfd9360-84eb-5a41-83e5-cf0d5465d616 with identifier: MC98570
2026-03-29 10:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ebfd9360-84eb-5a41-83e5-cf0d5465d616 with identifier: MC98570
2026-03-29 10:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ebfd9360-84eb-5a41-83e5-cf0d5465d616 with identifier: MC98570 to the API
2026-03-29 10:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:27:06Z',
 'fuel_type': 'petrol',
 'id': 'ebfd9360-84eb-5a41-83e5-cf0d5465d616',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC98570',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 230299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-02',
 'seller_name': None,
 'title': 'Citroen C4 1.6 VTR Plus',
 'transmission': 'automatic',
 'trim': 'VTR Plus',
 'year': 2006}
2026-03-29 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC98570%27 HTTP/1.1" 200 None
2026-03-29 10:35:55 [auto1.de] INFO: Saving data for MC98570: {'auction_closing_time': 1774884426.0, 'created_time': 1773304522.806209, 'last_price_update_time': 1774780555.905313}
2026-03-29 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MC98570') HTTP/1.1" 204 0
2026-03-29 10:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2eaa094c-fb8a-569f-b03b-98a5f3ed76ee with identifier: NC19407
2026-03-29 10:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2eaa094c-fb8a-569f-b03b-98a5f3ed76ee with identifier: NC19407
2026-03-29 10:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2eaa094c-fb8a-569f-b03b-98a5f3ed76ee with identifier: NC19407 to the API
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:15:21Z',
 'fuel_type': 'gas',
 'id': '2eaa094c-fb8a-569f-b03b-98a5f3ed76ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC19407',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 283840,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-22',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 TSI EcoFuel Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2010}
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC19407%27 HTTP/1.1" 200 None
2026-03-29 10:35:56 [auto1.de] INFO: Saving data for NC19407: {'auction_closing_time': 1774883721.0, 'created_time': 1773304267.35604, 'last_price_update_time': 1774780556.257898}
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC19407') HTTP/1.1" 204 0
2026-03-29 10:35:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: TU72063
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: JY14465
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY14465%27 HTTP/1.1" 200 None
2026-03-29 10:35:56 [auto1.de] INFO: Scrape type for JY14465: 1
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: AA02702
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: KG90894
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: WX41278
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: RC66900
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: FF58085
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: XV56284
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV56284%27 HTTP/1.1" 200 None
2026-03-29 10:35:56 [auto1.de] INFO: Scrape type for XV56284: 2
2026-03-29 10:35:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7864ee9e-f29c-5d81-928d-e5879f9aebbf with identifier: XV56284
2026-03-29 10:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7864ee9e-f29c-5d81-928d-e5879f9aebbf with scrape type 2
2026-03-29 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7864ee9e-f29c-5d81-928d-e5879f9aebbf with scrape type 2
2026-03-29 10:35:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7864ee9e-f29c-5d81-928d-e5879f9aebbf, identifier: XV56284
2026-03-29 10:35:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7864ee9e-f29c-5d81-928d-e5879f9aebbf with identifier: XV56284
2026-03-29 10:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7864ee9e-f29c-5d81-928d-e5879f9aebbf with identifier: XV56284
2026-03-29 10:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7864ee9e-f29c-5d81-928d-e5879f9aebbf with identifier: XV56284 to the API
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:07:28Z',
 'fuel_type': 'diesel',
 'id': '7864ee9e-f29c-5d81-928d-e5879f9aebbf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV56284',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 166210,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-31',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 HDi Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2009}
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV56284%27 HTTP/1.1" 200 None
2026-03-29 10:35:56 [auto1.de] INFO: Saving data for XV56284: {'auction_closing_time': 1774883248.0, 'created_time': 1774550912.214317, 'last_price_update_time': 1774780556.768295}
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV56284') HTTP/1.1" 204 0
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: GC94975
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: ZR75909
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: TT55225
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT55225%27 HTTP/1.1" 200 None
2026-03-29 10:35:56 [auto1.de] INFO: Scrape type for TT55225: 1
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: TR94323
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: EJ33834
2026-03-29 10:35:56 [auto1.de] INFO: Found listing with ID: KH07650
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH07650%27 HTTP/1.1" 200 None
2026-03-29 10:35:56 [auto1.de] INFO: Scrape type for KH07650: 2
2026-03-29 10:35:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cae4cab5-d35c-5c8f-90a5-c683dc29baf0 with identifier: KH07650
2026-03-29 10:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cae4cab5-d35c-5c8f-90a5-c683dc29baf0 with scrape type 2
2026-03-29 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cae4cab5-d35c-5c8f-90a5-c683dc29baf0 with scrape type 2
2026-03-29 10:35:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cae4cab5-d35c-5c8f-90a5-c683dc29baf0, identifier: KH07650
2026-03-29 10:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VY63295> (referer: https://www.auto1.com/v1/car-details-view/VY63295/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UH31359/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cae4cab5-d35c-5c8f-90a5-c683dc29baf0 with identifier: KH07650
2026-03-29 10:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cae4cab5-d35c-5c8f-90a5-c683dc29baf0 with identifier: KH07650
2026-03-29 10:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cae4cab5-d35c-5c8f-90a5-c683dc29baf0 with identifier: KH07650 to the API
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:57:55Z',
 'fuel_type': 'diesel',
 'id': 'cae4cab5-d35c-5c8f-90a5-c683dc29baf0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH07650',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Talento',
 'odometer': 111208,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-26',
 'seller_name': None,
 'title': 'Fiat Talento 1.6 TwinTurbo Diesel Ecojet L1H1 1,0t Family',
 'transmission': 'manual',
 'trim': 'L1H1 1,0t Family',
 'year': 2018}
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH07650%27 HTTP/1.1" 200 None
2026-03-29 10:35:57 [auto1.de] INFO: Saving data for KH07650: {'auction_closing_time': 1774886275.0, 'created_time': 1773571705.035339, 'last_price_update_time': 1774780557.310536}
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KH07650') HTTP/1.1" 204 0
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: EX17549
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX17549%27 HTTP/1.1" 200 None
2026-03-29 10:35:57 [auto1.de] INFO: Scrape type for EX17549: 2
2026-03-29 10:35:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11e8fa88-7aeb-531d-bc62-d898ec4f4c0b with identifier: EX17549
2026-03-29 10:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11e8fa88-7aeb-531d-bc62-d898ec4f4c0b with scrape type 2
2026-03-29 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11e8fa88-7aeb-531d-bc62-d898ec4f4c0b with scrape type 2
2026-03-29 10:35:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11e8fa88-7aeb-531d-bc62-d898ec4f4c0b, identifier: EX17549
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: FN39592
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: VV83737
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: YV56430
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: BS63746
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS63746%27 HTTP/1.1" 200 None
2026-03-29 10:35:57 [auto1.de] INFO: Scrape type for BS63746: 1
2026-03-29 10:35:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BE23086/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:35:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11e8fa88-7aeb-531d-bc62-d898ec4f4c0b with identifier: EX17549
2026-03-29 10:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11e8fa88-7aeb-531d-bc62-d898ec4f4c0b with identifier: EX17549
2026-03-29 10:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11e8fa88-7aeb-531d-bc62-d898ec4f4c0b with identifier: EX17549 to the API
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:54:31Z',
 'fuel_type': 'petrol',
 'id': '11e8fa88-7aeb-531d-bc62-d898ec4f4c0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX17549',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 99190,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-05',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 220 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX17549%27 HTTP/1.1" 200 None
2026-03-29 10:35:57 [auto1.de] INFO: Saving data for EX17549: {'auction_closing_time': 1774886071.0, 'created_time': 1773945955.646503, 'last_price_update_time': 1774780557.84359}
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX17549') HTTP/1.1" 204 0
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: TE08681
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE08681%27 HTTP/1.1" 200 None
2026-03-29 10:35:57 [auto1.de] INFO: Scrape type for TE08681: 1
2026-03-29 10:35:57 [auto1.de] INFO: Found listing with ID: MR97164
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR97164%27 HTTP/1.1" 200 None
2026-03-29 10:35:57 [auto1.de] INFO: Scrape type for MR97164: 2
2026-03-29 10:35:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8802af05-9077-5cca-8256-e3941e52e775 with identifier: MR97164
2026-03-29 10:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8802af05-9077-5cca-8256-e3941e52e775 with scrape type 2
2026-03-29 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8802af05-9077-5cca-8256-e3941e52e775 with scrape type 2
2026-03-29 10:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8802af05-9077-5cca-8256-e3941e52e775, identifier: MR97164
2026-03-29 10:35:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:58 [auto1.de] INFO: Channel: 24h | Page: 5 | totalHits: 6726 | hits on page: 40
2026-03-29 10:35:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8cd9b73-547c-5910-94f4-0a5ca644366d with identifier: VY63295
2026-03-29 10:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8cd9b73-547c-5910-94f4-0a5ca644366d with scrape type 1
2026-03-29 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b8cd9b73-547c-5910-94f4-0a5ca644366d
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F91%252Ffa91b9c68c646cc370e619bb9d0f581c%252Fpa%252FVY63295_dbc9d43d4ef16d9854b10f17a3b61d3d.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/91/fa91b9c68c646cc370e619bb9d0f581c/pa/VY63295_dbc9d43d4ef16d9854b10f17a3b61d3d.jpg already downloaded
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F91%252Ffa91b9c68c646cc370e619bb9d0f581c%252Fpa%252FVY63295_1d98dd4c840a24cc8fb39dca92534319.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/91/fa91b9c68c646cc370e619bb9d0f581c/pa/VY63295_1d98dd4c840a24cc8fb39dca92534319.jpg already downloaded
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F91%252Ffa91b9c68c646cc370e619bb9d0f581c%252Fpa%252FVY63295_fef58c9099dcc79fb3758d72ba4c7202.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/91/fa91b9c68c646cc370e619bb9d0f581c/pa/VY63295_fef58c9099dcc79fb3758d72ba4c7202.jpg already downloaded
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F91%252Ffa91b9c68c646cc370e619bb9d0f581c%252Fpa%252FVY63295_b862aff1e972e9843a2b4601bf3c3418.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/91/fa91b9c68c646cc370e619bb9d0f581c/pa/VY63295_b862aff1e972e9843a2b4601bf3c3418.jpg already downloaded
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F91%252Ffa91b9c68c646cc370e619bb9d0f581c%252Fpa%252FVY63295_4aec1dc5e6a1432c8b363a860278a02a.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/91/fa91b9c68c646cc370e619bb9d0f581c/pa/VY63295_4aec1dc5e6a1432c8b363a860278a02a.jpg already downloaded
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F91%252Ffa91b9c68c646cc370e619bb9d0f581c%252Fpa%252FVY63295_7f8210490a2d348caca198d7944fed2b.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/91/fa91b9c68c646cc370e619bb9d0f581c/pa/VY63295_7f8210490a2d348caca198d7944fed2b.jpg already downloaded
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F91%252Ffa91b9c68c646cc370e619bb9d0f581c%252Fpa%252FVY63295_1bffc06af054a88f47a3632302148883.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/91/fa91b9c68c646cc370e619bb9d0f581c/pa/VY63295_1bffc06af054a88f47a3632302148883.jpg already downloaded
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F91%252Ffa91b9c68c646cc370e619bb9d0f581c%252Fpa%252FVY63295_817901ed93cbab7c5a6df3fd6a3276f0.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/91/fa91b9c68c646cc370e619bb9d0f581c/pa/VY63295_817901ed93cbab7c5a6df3fd6a3276f0.jpg already downloaded
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F91%252Ffa91b9c68c646cc370e619bb9d0f581c%252Fpa%252FVY63295_3f9cfaedfa24701feecc969b598afc1f.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/91/fa91b9c68c646cc370e619bb9d0f581c/pa/VY63295_3f9cfaedfa24701feecc969b598afc1f.jpg already downloaded
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F91%252Ffa91b9c68c646cc370e619bb9d0f581c%252Fpa%252FVY63295_550dd674f8a9ff6ce5a8133f49a1f432.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/91/fa91b9c68c646cc370e619bb9d0f581c/pa/VY63295_550dd674f8a9ff6ce5a8133f49a1f432.jpg already downloaded
2026-03-29 10:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8cd9b73-547c-5910-94f4-0a5ca644366d, identifier: VY63295
2026-03-29 10:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8802af05-9077-5cca-8256-e3941e52e775 with identifier: MR97164
2026-03-29 10:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8802af05-9077-5cca-8256-e3941e52e775 with identifier: MR97164
2026-03-29 10:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8802af05-9077-5cca-8256-e3941e52e775 with identifier: MR97164 to the API
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 88,
 'expiration_date': '2026-03-30T15:55:37Z',
 'fuel_type': 'petrol',
 'id': '8802af05-9077-5cca-8256-e3941e52e775',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR97164',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 169812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-05-22',
 'seller_name': None,
 'title': 'Peugeot 207 1.4 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2006}
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR97164%27 HTTP/1.1" 200 None
2026-03-29 10:35:58 [auto1.de] INFO: Saving data for MR97164: {'auction_closing_time': 1774886137.0, 'created_time': 1773775938.949593, 'last_price_update_time': 1774780558.704545}
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR97164') HTTP/1.1" 204 0
2026-03-29 10:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8cd9b73-547c-5910-94f4-0a5ca644366d with identifier: VY63295
2026-03-29 10:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8cd9b73-547c-5910-94f4-0a5ca644366d with identifier: VY63295
2026-03-29 10:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8cd9b73-547c-5910-94f4-0a5ca644366d with identifier: VY63295 to the API
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VY63295>
{'auction_title': '',
 'c_o_2_emission_value': 178,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:56:45Z',
 'fuel_type': 'diesel',
 'id': 'b8cd9b73-547c-5910-94f4-0a5ca644366d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY63295',
 'listing': 'auction',
 'location': 'DE, Hemau',
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 82887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgfa/91/fa91b9c68c646cc370e619bb9d0f581c/pa/VY63295_dbc9d43d4ef16d9854b10f17a3b61d3d.jpg',
                'https://img-pa.auto1.com/imgfa/91/fa91b9c68c646cc370e619bb9d0f581c/pa/VY63295_1d98dd4c840a24cc8fb39dca92534319.jpg',
                'https://img-pa.auto1.com/imgfa/91/fa91b9c68c646cc370e619bb9d0f581c/pa/VY63295_fef58c9099dcc79fb3758d72ba4c7202.jpg',
                'https://img-pa.auto1.com/imgfa/91/fa91b9c68c646cc370e619bb9d0f581c/pa/VY63295_b862aff1e972e9843a2b4601bf3c3418.jpg',
                'https://img-pa.auto1.com/imgfa/91/fa91b9c68c646cc370e619bb9d0f581c/pa/VY63295_4aec1dc5e6a1432c8b363a860278a02a.jpg',
                'https://img-pa.auto1.com/imgfa/91/fa91b9c68c646cc370e619bb9d0f581c/pa/VY63295_7f8210490a2d348caca198d7944fed2b.jpg',
                'https://img-pa.auto1.com/imgfa/91/fa91b9c68c646cc370e619bb9d0f581c/pa/VY63295_1bffc06af054a88f47a3632302148883.jpg',
                'https://img-pa.auto1.com/imgfa/91/fa91b9c68c646cc370e619bb9d0f581c/pa/VY63295_817901ed93cbab7c5a6df3fd6a3276f0.jpg',
                'https://img-pa.auto1.com/imgfa/91/fa91b9c68c646cc370e619bb9d0f581c/pa/VY63295_3f9cfaedfa24701feecc969b598afc1f.jpg',
                'https://img-pa.auto1.com/imgfa/91/fa91b9c68c646cc370e619bb9d0f581c/pa/VY63295_550dd674f8a9ff6ce5a8133f49a1f432.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8cd9b73-547c-5910-94f4-0a5ca644366d/b8cd9b73-547c-5910-94f4-0a5ca644366d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/91/fa91b9c68c646cc370e619bb9d0f581c/pa/VY63295_dbc9d43d4ef16d9854b10f17a3b61d3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8cd9b73-547c-5910-94f4-0a5ca644366d/b8cd9b73-547c-5910-94f4-0a5ca644366d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/91/fa91b9c68c646cc370e619bb9d0f581c/pa/VY63295_1d98dd4c840a24cc8fb39dca92534319.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8cd9b73-547c-5910-94f4-0a5ca644366d/b8cd9b73-547c-5910-94f4-0a5ca644366d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/91/fa91b9c68c646cc370e619bb9d0f581c/pa/VY63295_fef58c9099dcc79fb3758d72ba4c7202.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8cd9b73-547c-5910-94f4-0a5ca644366d/b8cd9b73-547c-5910-94f4-0a5ca644366d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/91/fa91b9c68c646cc370e619bb9d0f581c/pa/VY63295_b862aff1e972e9843a2b4601bf3c3418.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8cd9b73-547c-5910-94f4-0a5ca644366d/b8cd9b73-547c-5910-94f4-0a5ca644366d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/91/fa91b9c68c646cc370e619bb9d0f581c/pa/VY63295_4aec1dc5e6a1432c8b363a860278a02a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8cd9b73-547c-5910-94f4-0a5ca644366d/b8cd9b73-547c-5910-94f4-0a5ca644366d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/91/fa91b9c68c646cc370e619bb9d0f581c/pa/VY63295_7f8210490a2d348caca198d7944fed2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8cd9b73-547c-5910-94f4-0a5ca644366d/b8cd9b73-547c-5910-94f4-0a5ca644366d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/91/fa91b9c68c646cc370e619bb9d0f581c/pa/VY63295_1bffc06af054a88f47a3632302148883.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8cd9b73-547c-5910-94f4-0a5ca644366d/b8cd9b73-547c-5910-94f4-0a5ca644366d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/91/fa91b9c68c646cc370e619bb9d0f581c/pa/VY63295_817901ed93cbab7c5a6df3fd6a3276f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8cd9b73-547c-5910-94f4-0a5ca644366d/b8cd9b73-547c-5910-94f4-0a5ca644366d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/91/fa91b9c68c646cc370e619bb9d0f581c/pa/VY63295_3f9cfaedfa24701feecc969b598afc1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8cd9b73-547c-5910-94f4-0a5ca644366d/b8cd9b73-547c-5910-94f4-0a5ca644366d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73275,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/91/fa91b9c68c646cc370e619bb9d0f581c/pa/VY63295_550dd674f8a9ff6ce5a8133f49a1f432.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar XF 20d R-Sport AWD',
 'transmission': 'automatic',
 'trim': 'R-Sport AWD',
 'year': 2019}
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY63295%27 HTTP/1.1" 200 None
2026-03-29 10:35:59 [auto1.de] INFO: Saving data for VY63295: {'created_time': 1774780559.091825, 'last_price_update_time': 1774780559.091836, 'auction_closing_time': 1774886205.0}
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY63295') HTTP/1.1" 204 0
2026-03-29 10:35:59 [auto1.de] INFO: Found listing with ID: HB21625
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB21625%27 HTTP/1.1" 200 None
2026-03-29 10:35:59 [auto1.de] INFO: Scrape type for HB21625: 1
2026-03-29 10:35:59 [auto1.de] INFO: Found listing with ID: BD67330
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD67330%27 HTTP/1.1" 200 None
2026-03-29 10:35:59 [auto1.de] INFO: Scrape type for BD67330: 2
2026-03-29 10:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5c2ecc5-3b83-5cc0-81b2-e28a62c3f144 with identifier: BD67330
2026-03-29 10:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5c2ecc5-3b83-5cc0-81b2-e28a62c3f144 with scrape type 2
2026-03-29 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5c2ecc5-3b83-5cc0-81b2-e28a62c3f144 with scrape type 2
2026-03-29 10:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5c2ecc5-3b83-5cc0-81b2-e28a62c3f144, identifier: BD67330
2026-03-29 10:35:59 [auto1.de] INFO: Found listing with ID: UJ19896
2026-03-29 10:35:59 [auto1.de] INFO: Found listing with ID: LN54864
2026-03-29 10:35:59 [auto1.de] INFO: Found listing with ID: ZL28977
2026-03-29 10:35:59 [auto1.de] INFO: Found listing with ID: GA07513
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA07513%27 HTTP/1.1" 200 None
2026-03-29 10:35:59 [auto1.de] INFO: Scrape type for GA07513: 1
2026-03-29 10:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5c2ecc5-3b83-5cc0-81b2-e28a62c3f144 with identifier: BD67330
2026-03-29 10:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5c2ecc5-3b83-5cc0-81b2-e28a62c3f144 with identifier: BD67330
2026-03-29 10:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5c2ecc5-3b83-5cc0-81b2-e28a62c3f144 with identifier: BD67330 to the API
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 280,
 'expiration_date': '2026-03-30T15:34:04Z',
 'fuel_type': 'petrol',
 'id': 'd5c2ecc5-3b83-5cc0-81b2-e28a62c3f144',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD67330',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 101608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-27',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.0 Turbo Super Q4',
 'transmission': 'automatic',
 'trim': 'Super Q4',
 'year': 2017}
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD67330%27 HTTP/1.1" 200 None
2026-03-29 10:35:59 [auto1.de] INFO: Saving data for BD67330: {'auction_closing_time': 1774884844.0, 'created_time': 1774550712.020694, 'last_price_update_time': 1774780559.602768}
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD67330') HTTP/1.1" 204 0
2026-03-29 10:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:35:59 [auto1.de] INFO: Found listing with ID: VE07121
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE07121%27 HTTP/1.1" 200 None
2026-03-29 10:35:59 [auto1.de] INFO: Scrape type for VE07121: 1
2026-03-29 10:35:59 [auto1.de] INFO: Found listing with ID: JC71292
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC71292%27 HTTP/1.1" 200 None
2026-03-29 10:35:59 [auto1.de] INFO: Scrape type for JC71292: 2
2026-03-29 10:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 823f78c4-8278-5605-a962-1f96ff2255ba with identifier: JC71292
2026-03-29 10:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 823f78c4-8278-5605-a962-1f96ff2255ba with scrape type 2
2026-03-29 10:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 823f78c4-8278-5605-a962-1f96ff2255ba with scrape type 2
2026-03-29 10:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 823f78c4-8278-5605-a962-1f96ff2255ba, identifier: JC71292
2026-03-29 10:35:59 [auto1.de] INFO: Found listing with ID: BS02635
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS02635%27 HTTP/1.1" 200 None
2026-03-29 10:35:59 [auto1.de] INFO: Scrape type for BS02635: 1
2026-03-29 10:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 823f78c4-8278-5605-a962-1f96ff2255ba with identifier: JC71292
2026-03-29 10:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 823f78c4-8278-5605-a962-1f96ff2255ba with identifier: JC71292
2026-03-29 10:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 823f78c4-8278-5605-a962-1f96ff2255ba with identifier: JC71292 to the API
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:06:31Z',
 'fuel_type': 'petrol',
 'id': '823f78c4-8278-5605-a962-1f96ff2255ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC71292',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 130325,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-02',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 Kompressor T Elegance',
 'transmission': 'manual',
 'trim': 'T Elegance',
 'year': 2007}
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC71292%27 HTTP/1.1" 200 None
2026-03-29 10:36:00 [auto1.de] INFO: Saving data for JC71292: {'auction_closing_time': 1774883191.0, 'created_time': 1773945557.783348, 'last_price_update_time': 1774780560.096054}
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JC71292') HTTP/1.1" 204 0
2026-03-29 10:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MZ37823/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: RT89872
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: YW33550
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: XY86775
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY86775%27 HTTP/1.1" 200 None
2026-03-29 10:36:00 [auto1.de] INFO: Scrape type for XY86775: 2
2026-03-29 10:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e14b760-2a21-5f5f-8d0f-b546f844864e with identifier: XY86775
2026-03-29 10:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e14b760-2a21-5f5f-8d0f-b546f844864e with scrape type 2
2026-03-29 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e14b760-2a21-5f5f-8d0f-b546f844864e with scrape type 2
2026-03-29 10:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e14b760-2a21-5f5f-8d0f-b546f844864e, identifier: XY86775
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: FE29735
2026-03-29 10:36:00 [auto1.de] INFO: Found listing with ID: TB77068
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB77068%27 HTTP/1.1" 200 None
2026-03-29 10:36:00 [auto1.de] INFO: Scrape type for TB77068: 2
2026-03-29 10:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e261b936-f182-5ba8-8b0b-f8e71d10a127 with identifier: TB77068
2026-03-29 10:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e261b936-f182-5ba8-8b0b-f8e71d10a127 with scrape type 2
2026-03-29 10:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e261b936-f182-5ba8-8b0b-f8e71d10a127 with scrape type 2
2026-03-29 10:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e261b936-f182-5ba8-8b0b-f8e71d10a127, identifier: TB77068
2026-03-29 10:36:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e14b760-2a21-5f5f-8d0f-b546f844864e with identifier: XY86775
2026-03-29 10:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e14b760-2a21-5f5f-8d0f-b546f844864e with identifier: XY86775
2026-03-29 10:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e14b760-2a21-5f5f-8d0f-b546f844864e with identifier: XY86775 to the API
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:23:04Z',
 'fuel_type': 'petrol',
 'id': '1e14b760-2a21-5f5f-8d0f-b546f844864e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY86775',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 225462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-04-30',
 'seller_name': None,
 'title': 'BMW 5er 525i',
 'transmission': 'manual',
 'trim': '',
 'year': 2002}
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY86775%27 HTTP/1.1" 200 None
2026-03-29 10:36:00 [auto1.de] INFO: Saving data for XY86775: {'auction_closing_time': 1774884184.0, 'created_time': 1773429710.596912, 'last_price_update_time': 1774780560.781164}
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY86775') HTTP/1.1" 204 0
2026-03-29 10:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e261b936-f182-5ba8-8b0b-f8e71d10a127 with identifier: TB77068
2026-03-29 10:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e261b936-f182-5ba8-8b0b-f8e71d10a127 with identifier: TB77068
2026-03-29 10:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e261b936-f182-5ba8-8b0b-f8e71d10a127 with identifier: TB77068 to the API
2026-03-29 10:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 203,
 'expiration_date': '2026-03-30T15:04:08Z',
 'fuel_type': 'petrol',
 'id': 'e261b936-f182-5ba8-8b0b-f8e71d10a127',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB77068',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 71653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-08',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2015}
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB77068%27 HTTP/1.1" 200 None
2026-03-29 10:36:01 [auto1.de] INFO: Saving data for TB77068: {'auction_closing_time': 1774883048.0, 'created_time': 1773772832.755547, 'last_price_update_time': 1774780561.131197}
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB77068') HTTP/1.1" 204 0
2026-03-29 10:36:01 [auto1.de] INFO: Found listing with ID: EC15325
2026-03-29 10:36:01 [auto1.de] INFO: Found listing with ID: TL60563
2026-03-29 10:36:01 [auto1.de] INFO: Found listing with ID: GF90377
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF90377%27 HTTP/1.1" 200 None
2026-03-29 10:36:01 [auto1.de] INFO: Scrape type for GF90377: 2
2026-03-29 10:36:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 339ea701-9bb8-5e66-bff9-a5ece4b36499 with identifier: GF90377
2026-03-29 10:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 339ea701-9bb8-5e66-bff9-a5ece4b36499 with scrape type 2
2026-03-29 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 339ea701-9bb8-5e66-bff9-a5ece4b36499 with scrape type 2
2026-03-29 10:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 339ea701-9bb8-5e66-bff9-a5ece4b36499, identifier: GF90377
2026-03-29 10:36:01 [auto1.de] INFO: Found listing with ID: UB74163
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB74163%27 HTTP/1.1" 200 None
2026-03-29 10:36:01 [auto1.de] INFO: Scrape type for UB74163: 2
2026-03-29 10:36:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adbd38d5-fcba-5f7f-8d59-b82bd50f5962 with identifier: UB74163
2026-03-29 10:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adbd38d5-fcba-5f7f-8d59-b82bd50f5962 with scrape type 2
2026-03-29 10:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item adbd38d5-fcba-5f7f-8d59-b82bd50f5962 with scrape type 2
2026-03-29 10:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: adbd38d5-fcba-5f7f-8d59-b82bd50f5962, identifier: UB74163
2026-03-29 10:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 339ea701-9bb8-5e66-bff9-a5ece4b36499 with identifier: GF90377
2026-03-29 10:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 339ea701-9bb8-5e66-bff9-a5ece4b36499 with identifier: GF90377
2026-03-29 10:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 339ea701-9bb8-5e66-bff9-a5ece4b36499 with identifier: GF90377 to the API
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:22:26Z',
 'fuel_type': 'petrol',
 'id': '339ea701-9bb8-5e66-bff9-a5ece4b36499',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF90377',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 215437,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-09-27',
 'seller_name': None,
 'title': 'Honda Civic 1.4 Sport Unlimited',
 'transmission': 'manual',
 'trim': 'Sport Unlimited',
 'year': 2005}
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF90377%27 HTTP/1.1" 200 None
2026-03-29 10:36:01 [auto1.de] INFO: Saving data for GF90377: {'auction_closing_time': 1774884146.0, 'created_time': 1774550901.603305, 'last_price_update_time': 1774780561.709519}
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF90377') HTTP/1.1" 204 0
2026-03-29 10:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: adbd38d5-fcba-5f7f-8d59-b82bd50f5962 with identifier: UB74163
2026-03-29 10:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: adbd38d5-fcba-5f7f-8d59-b82bd50f5962 with identifier: UB74163
2026-03-29 10:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: adbd38d5-fcba-5f7f-8d59-b82bd50f5962 with identifier: UB74163 to the API
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:55:03Z',
 'fuel_type': 'diesel',
 'id': 'adbd38d5-fcba-5f7f-8d59-b82bd50f5962',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB74163',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumper',
 'odometer': 227020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-12',
 'seller_name': None,
 'title': 'Citroen Jumper 2.0 Blue-HDi 35 L2H2 Profi',
 'transmission': 'manual',
 'trim': '35 L2H2 Profi',
 'year': 2017}
2026-03-29 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB74163%27 HTTP/1.1" 200 None
2026-03-29 10:36:02 [auto1.de] INFO: Saving data for UB74163: {'auction_closing_time': 1774886103.0, 'created_time': 1774553111.490565, 'last_price_update_time': 1774780562.076872}
2026-03-29 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB74163') HTTP/1.1" 204 0
2026-03-29 10:36:02 [auto1.de] INFO: Found listing with ID: EX05236
2026-03-29 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX05236%27 HTTP/1.1" 200 None
2026-03-29 10:36:02 [auto1.de] INFO: Scrape type for EX05236: 2
2026-03-29 10:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64f6ffe1-ec1e-550e-90d9-e92bf3d807f3 with identifier: EX05236
2026-03-29 10:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64f6ffe1-ec1e-550e-90d9-e92bf3d807f3 with scrape type 2
2026-03-29 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64f6ffe1-ec1e-550e-90d9-e92bf3d807f3 with scrape type 2
2026-03-29 10:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64f6ffe1-ec1e-550e-90d9-e92bf3d807f3, identifier: EX05236
2026-03-29 10:36:02 [auto1.de] INFO: Found listing with ID: NB51359
2026-03-29 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB51359%27 HTTP/1.1" 200 None
2026-03-29 10:36:02 [auto1.de] INFO: Scrape type for NB51359: 1
2026-03-29 10:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JY14465/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64f6ffe1-ec1e-550e-90d9-e92bf3d807f3 with identifier: EX05236
2026-03-29 10:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 10:36:02 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-29 10:36:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 10:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64f6ffe1-ec1e-550e-90d9-e92bf3d807f3 with identifier: EX05236
2026-03-29 10:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64f6ffe1-ec1e-550e-90d9-e92bf3d807f3 with identifier: EX05236 to the API
2026-03-29 10:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:06:50Z',
 'fuel_type': 'petrol',
 'id': '64f6ffe1-ec1e-550e-90d9-e92bf3d807f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX05236',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 233431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-07-11',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 320 Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2000}
2026-03-29 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX05236%27 HTTP/1.1" 200 None
2026-03-29 10:36:02 [auto1.de] INFO: Saving data for EX05236: {'auction_closing_time': 1774883210.0, 'created_time': 1774637243.437582, 'last_price_update_time': 1774780562.735162}
2026-03-29 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX05236') HTTP/1.1" 204 0
2026-03-29 10:36:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TT55225/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:02 [auto1.de] INFO: Found listing with ID: RR70760
2026-03-29 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR70760%27 HTTP/1.1" 200 None
2026-03-29 10:36:02 [auto1.de] INFO: Scrape type for RR70760: 1
2026-03-29 10:36:02 [auto1.de] INFO: Found listing with ID: SP94156
2026-03-29 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP94156%27 HTTP/1.1" 200 None
2026-03-29 10:36:02 [auto1.de] INFO: Scrape type for SP94156: 2
2026-03-29 10:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 213e48cf-6509-5b28-b77c-3f20cd675be9 with identifier: SP94156
2026-03-29 10:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 213e48cf-6509-5b28-b77c-3f20cd675be9 with scrape type 2
2026-03-29 10:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 213e48cf-6509-5b28-b77c-3f20cd675be9 with scrape type 2
2026-03-29 10:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 213e48cf-6509-5b28-b77c-3f20cd675be9, identifier: SP94156
2026-03-29 10:36:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BS63746/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 213e48cf-6509-5b28-b77c-3f20cd675be9 with identifier: SP94156
2026-03-29 10:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 213e48cf-6509-5b28-b77c-3f20cd675be9 with identifier: SP94156
2026-03-29 10:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 213e48cf-6509-5b28-b77c-3f20cd675be9 with identifier: SP94156 to the API
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:22:05Z',
 'fuel_type': 'diesel',
 'id': '213e48cf-6509-5b28-b77c-3f20cd675be9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP94156',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 277006,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-06',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2009}
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP94156%27 HTTP/1.1" 200 None
2026-03-29 10:36:03 [auto1.de] INFO: Saving data for SP94156: {'auction_closing_time': 1774884125.0, 'created_time': 1772540577.198826, 'last_price_update_time': 1774780563.32221}
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP94156') HTTP/1.1" 204 0
2026-03-29 10:36:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: FY44506
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY44506%27 HTTP/1.1" 200 None
2026-03-29 10:36:03 [auto1.de] INFO: Scrape type for FY44506: 2
2026-03-29 10:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e9226d1-ab29-5de1-88dc-137f9c5178a7 with identifier: FY44506
2026-03-29 10:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e9226d1-ab29-5de1-88dc-137f9c5178a7 with scrape type 2
2026-03-29 10:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e9226d1-ab29-5de1-88dc-137f9c5178a7 with scrape type 2
2026-03-29 10:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e9226d1-ab29-5de1-88dc-137f9c5178a7, identifier: FY44506
2026-03-29 10:36:03 [auto1.de] INFO: Found listing with ID: KJ70545
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ70545%27 HTTP/1.1" 200 None
2026-03-29 10:36:03 [auto1.de] INFO: Scrape type for KJ70545: 2
2026-03-29 10:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 300ea696-46c2-5488-ba9b-ab4c8e457fdc with identifier: KJ70545
2026-03-29 10:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 300ea696-46c2-5488-ba9b-ab4c8e457fdc with scrape type 2
2026-03-29 10:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 300ea696-46c2-5488-ba9b-ab4c8e457fdc with scrape type 2
2026-03-29 10:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 300ea696-46c2-5488-ba9b-ab4c8e457fdc, identifier: KJ70545
2026-03-29 10:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e9226d1-ab29-5de1-88dc-137f9c5178a7 with identifier: FY44506
2026-03-29 10:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e9226d1-ab29-5de1-88dc-137f9c5178a7 with identifier: FY44506
2026-03-29 10:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e9226d1-ab29-5de1-88dc-137f9c5178a7 with identifier: FY44506 to the API
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:32:45Z',
 'fuel_type': 'diesel',
 'id': '3e9226d1-ab29-5de1-88dc-137f9c5178a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY44506',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-24',
 'seller_name': None,
 'title': 'Kia Sorento 2.5 CRDi VGT EX',
 'transmission': 'manual',
 'trim': 'VGT EX',
 'year': 2009}
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY44506%27 HTTP/1.1" 200 None
2026-03-29 10:36:03 [auto1.de] INFO: Saving data for FY44506: {'auction_closing_time': 1774884765.0, 'created_time': 1773775713.179534, 'last_price_update_time': 1774780563.92313}
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY44506') HTTP/1.1" 204 0
2026-03-29 10:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 300ea696-46c2-5488-ba9b-ab4c8e457fdc with identifier: KJ70545
2026-03-29 10:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 300ea696-46c2-5488-ba9b-ab4c8e457fdc with identifier: KJ70545
2026-03-29 10:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 300ea696-46c2-5488-ba9b-ab4c8e457fdc with identifier: KJ70545 to the API
2026-03-29 10:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:10:02Z',
 'fuel_type': 'petrol',
 'id': '300ea696-46c2-5488-ba9b-ab4c8e457fdc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ70545',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 110451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-28',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Sport & Style BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Sport & Style BlueMotion Tech',
 'year': 2014}
2026-03-29 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ70545%27 HTTP/1.1" 200 None
2026-03-29 10:36:05 [auto1.de] INFO: Saving data for KJ70545: {'auction_closing_time': 1774883402.0, 'created_time': 1774550704.450878, 'last_price_update_time': 1774780565.199327}
2026-03-29 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ70545') HTTP/1.1" 204 0
2026-03-29 10:36:05 [auto1.de] INFO: Found listing with ID: DC02620
2026-03-29 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC02620%27 HTTP/1.1" 200 None
2026-03-29 10:36:05 [auto1.de] INFO: Scrape type for DC02620: 2
2026-03-29 10:36:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b512a2db-f20e-5850-a9c3-dbdaead5c751 with identifier: DC02620
2026-03-29 10:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b512a2db-f20e-5850-a9c3-dbdaead5c751 with scrape type 2
2026-03-29 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b512a2db-f20e-5850-a9c3-dbdaead5c751 with scrape type 2
2026-03-29 10:36:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b512a2db-f20e-5850-a9c3-dbdaead5c751, identifier: DC02620
2026-03-29 10:36:05 [auto1.de] INFO: Found listing with ID: XW55257
2026-03-29 10:36:05 [auto1.de] INFO: Found listing with ID: NV52830
2026-03-29 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV52830%27 HTTP/1.1" 200 None
2026-03-29 10:36:05 [auto1.de] INFO: Scrape type for NV52830: 2
2026-03-29 10:36:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f99cb84f-36b6-5c76-b12f-690073714431 with identifier: NV52830
2026-03-29 10:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f99cb84f-36b6-5c76-b12f-690073714431 with scrape type 2
2026-03-29 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f99cb84f-36b6-5c76-b12f-690073714431 with scrape type 2
2026-03-29 10:36:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f99cb84f-36b6-5c76-b12f-690073714431, identifier: NV52830
2026-03-29 10:36:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b512a2db-f20e-5850-a9c3-dbdaead5c751 with identifier: DC02620
2026-03-29 10:36:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b512a2db-f20e-5850-a9c3-dbdaead5c751 with identifier: DC02620
2026-03-29 10:36:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b512a2db-f20e-5850-a9c3-dbdaead5c751 with identifier: DC02620 to the API
2026-03-29 10:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:17:41Z',
 'fuel_type': 'diesel',
 'id': 'b512a2db-f20e-5850-a9c3-dbdaead5c751',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC02620',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 260020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-09-18',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2003}
2026-03-29 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC02620%27 HTTP/1.1" 200 None
2026-03-29 10:36:05 [auto1.de] INFO: Saving data for DC02620: {'auction_closing_time': 1774883861.0, 'created_time': 1773302030.958385, 'last_price_update_time': 1774780565.804386}
2026-03-29 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DC02620') HTTP/1.1" 204 0
2026-03-29 10:36:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f99cb84f-36b6-5c76-b12f-690073714431 with identifier: NV52830
2026-03-29 10:36:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f99cb84f-36b6-5c76-b12f-690073714431 with identifier: NV52830
2026-03-29 10:36:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f99cb84f-36b6-5c76-b12f-690073714431 with identifier: NV52830 to the API
2026-03-29 10:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:53:00Z',
 'fuel_type': 'petrol',
 'id': 'f99cb84f-36b6-5c76-b12f-690073714431',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV52830',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 203578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-05',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 150 Classic',
 'transmission': 'automatic',
 'trim': 'Classic',
 'year': 2009}
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV52830%27 HTTP/1.1" 200 None
2026-03-29 10:36:06 [auto1.de] INFO: Saving data for NV52830: {'auction_closing_time': 1774885980.0, 'created_time': 1773399862.618445, 'last_price_update_time': 1774780566.149652}
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV52830') HTTP/1.1" 204 0
2026-03-29 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TE08681/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: LF08399
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF08399%27 HTTP/1.1" 200 None
2026-03-29 10:36:06 [auto1.de] INFO: Scrape type for LF08399: 2
2026-03-29 10:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55f9a8c7-5625-5997-9c23-9cf40f7497f3 with identifier: LF08399
2026-03-29 10:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55f9a8c7-5625-5997-9c23-9cf40f7497f3 with scrape type 2
2026-03-29 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55f9a8c7-5625-5997-9c23-9cf40f7497f3 with scrape type 2
2026-03-29 10:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55f9a8c7-5625-5997-9c23-9cf40f7497f3, identifier: LF08399
2026-03-29 10:36:06 [auto1.de] INFO: Found listing with ID: WM05984
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM05984%27 HTTP/1.1" 200 None
2026-03-29 10:36:06 [auto1.de] INFO: Scrape type for WM05984: 2
2026-03-29 10:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8bb33f4-e126-5bee-ac3d-fd549d1af91f with identifier: WM05984
2026-03-29 10:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8bb33f4-e126-5bee-ac3d-fd549d1af91f with scrape type 2
2026-03-29 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8bb33f4-e126-5bee-ac3d-fd549d1af91f with scrape type 2
2026-03-29 10:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8bb33f4-e126-5bee-ac3d-fd549d1af91f, identifier: WM05984
2026-03-29 10:36:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UH31359> (referer: https://www.auto1.com/v1/car-details-view/UH31359/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GA07513/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55f9a8c7-5625-5997-9c23-9cf40f7497f3 with identifier: LF08399
2026-03-29 10:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55f9a8c7-5625-5997-9c23-9cf40f7497f3 with identifier: LF08399
2026-03-29 10:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55f9a8c7-5625-5997-9c23-9cf40f7497f3 with identifier: LF08399 to the API
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:38:51Z',
 'fuel_type': 'petrol',
 'id': '55f9a8c7-5625-5997-9c23-9cf40f7497f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF08399',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 171583,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-08-31',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.6 FSI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2004}
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF08399%27 HTTP/1.1" 200 None
2026-03-29 10:36:06 [auto1.de] INFO: Saving data for LF08399: {'auction_closing_time': 1774885131.0, 'created_time': 1773774404.035824, 'last_price_update_time': 1774780566.742184}
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LF08399') HTTP/1.1" 204 0
2026-03-29 10:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8bb33f4-e126-5bee-ac3d-fd549d1af91f with identifier: WM05984
2026-03-29 10:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8bb33f4-e126-5bee-ac3d-fd549d1af91f with identifier: WM05984
2026-03-29 10:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8bb33f4-e126-5bee-ac3d-fd549d1af91f with identifier: WM05984 to the API
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:11:27Z',
 'fuel_type': 'petrol',
 'id': 'd8bb33f4-e126-5bee-ac3d-fd549d1af91f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM05984',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 216591,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-18',
 'seller_name': None,
 'title': 'Honda Civic 1.8 VTEC Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2009}
2026-03-29 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM05984%27 HTTP/1.1" 200 None
2026-03-29 10:36:07 [auto1.de] INFO: Saving data for WM05984: {'auction_closing_time': 1774883487.0, 'created_time': 1773301583.713771, 'last_price_update_time': 1774780567.076756}
2026-03-29 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WM05984') HTTP/1.1" 204 0
2026-03-29 10:36:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:07 [scrapy.extensions.logstats] INFO: Crawled 23 pages (at 23 pages/min), scraped 88 items (at 88 items/min)
2026-03-29 10:36:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 159MiB
2026-03-29 10:36:07 [auto1.de] INFO: Found listing with ID: XW84981
2026-03-29 10:36:07 [auto1.de] INFO: Found listing with ID: MT41300
2026-03-29 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT41300%27 HTTP/1.1" 200 None
2026-03-29 10:36:07 [auto1.de] INFO: Scrape type for MT41300: 2
2026-03-29 10:36:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 339b07bc-89bb-579e-aba1-1a3a096a31e4 with identifier: MT41300
2026-03-29 10:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 339b07bc-89bb-579e-aba1-1a3a096a31e4 with scrape type 2
2026-03-29 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 339b07bc-89bb-579e-aba1-1a3a096a31e4 with scrape type 2
2026-03-29 10:36:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 339b07bc-89bb-579e-aba1-1a3a096a31e4, identifier: MT41300
2026-03-29 10:36:07 [auto1.de] INFO: Found listing with ID: TY76082
2026-03-29 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY76082%27 HTTP/1.1" 200 None
2026-03-29 10:36:07 [auto1.de] INFO: Scrape type for TY76082: 2
2026-03-29 10:36:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11881326-7ff9-5747-a410-6e5a015b12c3 with identifier: TY76082
2026-03-29 10:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11881326-7ff9-5747-a410-6e5a015b12c3 with scrape type 2
2026-03-29 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11881326-7ff9-5747-a410-6e5a015b12c3 with scrape type 2
2026-03-29 10:36:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11881326-7ff9-5747-a410-6e5a015b12c3, identifier: TY76082
2026-03-29 10:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 339b07bc-89bb-579e-aba1-1a3a096a31e4 with identifier: MT41300
2026-03-29 10:36:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 339b07bc-89bb-579e-aba1-1a3a096a31e4 with identifier: MT41300
2026-03-29 10:36:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 339b07bc-89bb-579e-aba1-1a3a096a31e4 with identifier: MT41300 to the API
2026-03-29 10:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:10:01Z',
 'fuel_type': 'diesel',
 'id': '339b07bc-89bb-579e-aba1-1a3a096a31e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT41300',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 178721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-01',
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TDI Highline 4Motion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion',
 'year': 2017}
2026-03-29 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT41300%27 HTTP/1.1" 200 None
2026-03-29 10:36:07 [auto1.de] INFO: Saving data for MT41300: {'auction_closing_time': 1774883401.0, 'created_time': 1774379565.332845, 'last_price_update_time': 1774780567.624638}
2026-03-29 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MT41300') HTTP/1.1" 204 0
2026-03-29 10:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11881326-7ff9-5747-a410-6e5a015b12c3 with identifier: TY76082
2026-03-29 10:36:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11881326-7ff9-5747-a410-6e5a015b12c3 with identifier: TY76082
2026-03-29 10:36:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11881326-7ff9-5747-a410-6e5a015b12c3 with identifier: TY76082 to the API
2026-03-29 10:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:36:50Z',
 'fuel_type': 'diesel',
 'id': '11881326-7ff9-5747-a410-6e5a015b12c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY76082',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 171448,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-07',
 'seller_name': None,
 'title': 'Audi A4 40 TDI Mild-Hybrid quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2021}
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY76082%27 HTTP/1.1" 200 None
2026-03-29 10:36:08 [auto1.de] INFO: Saving data for TY76082: {'auction_closing_time': 1774885010.0, 'created_time': 1774465895.690799, 'last_price_update_time': 1774780568.133135}
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TY76082') HTTP/1.1" 204 0
2026-03-29 10:36:08 [auto1.de] INFO: Found listing with ID: WT31487
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT31487%27 HTTP/1.1" 200 None
2026-03-29 10:36:08 [auto1.de] INFO: Scrape type for WT31487: 2
2026-03-29 10:36:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5e03435-d636-5f99-91bf-c08e2680c685 with identifier: WT31487
2026-03-29 10:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5e03435-d636-5f99-91bf-c08e2680c685 with scrape type 2
2026-03-29 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5e03435-d636-5f99-91bf-c08e2680c685 with scrape type 2
2026-03-29 10:36:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a5e03435-d636-5f99-91bf-c08e2680c685, identifier: WT31487
2026-03-29 10:36:08 [auto1.de] INFO: Found listing with ID: VN17699
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN17699%27 HTTP/1.1" 200 None
2026-03-29 10:36:08 [auto1.de] INFO: Scrape type for VN17699: 2
2026-03-29 10:36:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4d33a1a-6f57-50be-9c43-d5c688b362f9 with identifier: VN17699
2026-03-29 10:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4d33a1a-6f57-50be-9c43-d5c688b362f9 with scrape type 2
2026-03-29 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4d33a1a-6f57-50be-9c43-d5c688b362f9 with scrape type 2
2026-03-29 10:36:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e4d33a1a-6f57-50be-9c43-d5c688b362f9, identifier: VN17699
2026-03-29 10:36:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a5e03435-d636-5f99-91bf-c08e2680c685 with identifier: WT31487
2026-03-29 10:36:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a5e03435-d636-5f99-91bf-c08e2680c685 with identifier: WT31487
2026-03-29 10:36:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a5e03435-d636-5f99-91bf-c08e2680c685 with identifier: WT31487 to the API
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:26:32Z',
 'fuel_type': 'petrol',
 'id': 'a5e03435-d636-5f99-91bf-c08e2680c685',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT31487',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 93569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-29',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2016}
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT31487%27 HTTP/1.1" 200 None
2026-03-29 10:36:08 [auto1.de] INFO: Saving data for WT31487: {'auction_closing_time': 1774884392.0, 'created_time': 1774463794.227068, 'last_price_update_time': 1774780568.695477}
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WT31487') HTTP/1.1" 204 0
2026-03-29 10:36:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e4d33a1a-6f57-50be-9c43-d5c688b362f9 with identifier: VN17699
2026-03-29 10:36:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e4d33a1a-6f57-50be-9c43-d5c688b362f9 with identifier: VN17699
2026-03-29 10:36:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e4d33a1a-6f57-50be-9c43-d5c688b362f9 with identifier: VN17699 to the API
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:56:50Z',
 'fuel_type': 'diesel',
 'id': 'e4d33a1a-6f57-50be-9c43-d5c688b362f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN17699',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 77687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-24',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI T BlueTEC Elegance',
 'transmission': 'automatic',
 'trim': 'T BlueTEC Elegance',
 'year': 2016}
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN17699%27 HTTP/1.1" 200 None
2026-03-29 10:36:09 [auto1.de] INFO: Saving data for VN17699: {'auction_closing_time': 1774886210.0, 'created_time': 1773859203.772092, 'last_price_update_time': 1774780569.033299}
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN17699') HTTP/1.1" 204 0
2026-03-29 10:36:09 [auto1.de] INFO: Channel: 24h | Page: 6 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a5806fa-d8db-5374-8126-2f9923f37fc6 with identifier: UH31359
2026-03-29 10:36:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a5806fa-d8db-5374-8126-2f9923f37fc6 with scrape type 1
2026-03-29 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1a5806fa-d8db-5374-8126-2f9923f37fc6
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Faa%252F2faab6627c46efa104c760d880b69033%252Fpa%252FUH31359_6695023700965b55004e64abd4029943.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/aa/2faab6627c46efa104c760d880b69033/pa/UH31359_6695023700965b55004e64abd4029943.jpg already downloaded
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Faa%252F2faab6627c46efa104c760d880b69033%252Fpa%252FUH31359_d9afbb5789c15c0d5572c80bffa59b0a.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/aa/2faab6627c46efa104c760d880b69033/pa/UH31359_d9afbb5789c15c0d5572c80bffa59b0a.jpg already downloaded
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Faa%252F2faab6627c46efa104c760d880b69033%252Fpa%252FUH31359_5a88f0c4d476a95644772816699e0fa7.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/aa/2faab6627c46efa104c760d880b69033/pa/UH31359_5a88f0c4d476a95644772816699e0fa7.jpg already downloaded
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Faa%252F2faab6627c46efa104c760d880b69033%252Fpa%252FUH31359_3bdaf32b0317c7e1b3e613ef24ce046a.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/aa/2faab6627c46efa104c760d880b69033/pa/UH31359_3bdaf32b0317c7e1b3e613ef24ce046a.jpg already downloaded
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Faa%252F2faab6627c46efa104c760d880b69033%252Fpa%252FUH31359_d67b5734c89ded4970a2e77906f9bd37.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/aa/2faab6627c46efa104c760d880b69033/pa/UH31359_d67b5734c89ded4970a2e77906f9bd37.jpg already downloaded
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Faa%252F2faab6627c46efa104c760d880b69033%252Fpa%252FUH31359_4e66b432f50fd9eb9bde873d413f7c15.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/aa/2faab6627c46efa104c760d880b69033/pa/UH31359_4e66b432f50fd9eb9bde873d413f7c15.jpg already downloaded
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Faa%252F2faab6627c46efa104c760d880b69033%252Fpa%252FUH31359_c5181e0fd0bf2dd97fc554ec92d10eee.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/aa/2faab6627c46efa104c760d880b69033/pa/UH31359_c5181e0fd0bf2dd97fc554ec92d10eee.jpg already downloaded
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Faa%252F2faab6627c46efa104c760d880b69033%252Fpa%252FUH31359_454e2eca2f36f43fc4e7387d2bb28e58.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/aa/2faab6627c46efa104c760d880b69033/pa/UH31359_454e2eca2f36f43fc4e7387d2bb28e58.jpg already downloaded
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Faa%252F2faab6627c46efa104c760d880b69033%252Fpa%252FUH31359_afbb6c8c1dd52d9e45e4f03da0ea39c0.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/aa/2faab6627c46efa104c760d880b69033/pa/UH31359_afbb6c8c1dd52d9e45e4f03da0ea39c0.jpg already downloaded
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252Faa%252F2faab6627c46efa104c760d880b69033%252Fpa%252FUH31359_d2792977371aa0725d1e7213d51d0e8f.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/aa/2faab6627c46efa104c760d880b69033/pa/UH31359_d2792977371aa0725d1e7213d51d0e8f.jpg already downloaded
2026-03-29 10:36:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a5806fa-d8db-5374-8126-2f9923f37fc6, identifier: UH31359
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: XE54390
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: HB92022
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB92022%27 HTTP/1.1" 200 None
2026-03-29 10:36:09 [auto1.de] INFO: Scrape type for HB92022: 1
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: FG48186
2026-03-29 10:36:09 [auto1.de] INFO: Found listing with ID: EC36111
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC36111%27 HTTP/1.1" 200 None
2026-03-29 10:36:09 [auto1.de] INFO: Scrape type for EC36111: 2
2026-03-29 10:36:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b04275d4-e3e9-5b86-85b9-d3df253cb748 with identifier: EC36111
2026-03-29 10:36:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b04275d4-e3e9-5b86-85b9-d3df253cb748 with scrape type 2
2026-03-29 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b04275d4-e3e9-5b86-85b9-d3df253cb748 with scrape type 2
2026-03-29 10:36:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b04275d4-e3e9-5b86-85b9-d3df253cb748, identifier: EC36111
2026-03-29 10:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BE23086> (referer: https://www.auto1.com/v1/car-details-view/BE23086/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a5806fa-d8db-5374-8126-2f9923f37fc6 with identifier: UH31359
2026-03-29 10:36:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a5806fa-d8db-5374-8126-2f9923f37fc6 with identifier: UH31359
2026-03-29 10:36:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a5806fa-d8db-5374-8126-2f9923f37fc6 with identifier: UH31359 to the API
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UH31359>
{'auction_title': '',
 'c_o_2_emission_value': 222,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 250,
 'expiration_date': '2026-03-30T15:37:51Z',
 'fuel_type': 'petrol',
 'id': '1a5806fa-d8db-5374-8126-2f9923f37fc6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH31359',
 'listing': 'auction',
 'location': 'DE, Atting',
 'make': 'Jaguar',
 'model': 'F-Pace',
 'odometer': 60739,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img2f/aa/2faab6627c46efa104c760d880b69033/pa/UH31359_6695023700965b55004e64abd4029943.jpg',
                'https://img-pa.auto1.com/img2f/aa/2faab6627c46efa104c760d880b69033/pa/UH31359_d9afbb5789c15c0d5572c80bffa59b0a.jpg',
                'https://img-pa.auto1.com/img2f/aa/2faab6627c46efa104c760d880b69033/pa/UH31359_5a88f0c4d476a95644772816699e0fa7.jpg',
                'https://img-pa.auto1.com/img2f/aa/2faab6627c46efa104c760d880b69033/pa/UH31359_3bdaf32b0317c7e1b3e613ef24ce046a.jpg',
                'https://img-pa.auto1.com/img2f/aa/2faab6627c46efa104c760d880b69033/pa/UH31359_d67b5734c89ded4970a2e77906f9bd37.jpg',
                'https://img-pa.auto1.com/img2f/aa/2faab6627c46efa104c760d880b69033/pa/UH31359_4e66b432f50fd9eb9bde873d413f7c15.jpg',
                'https://img-pa.auto1.com/img2f/aa/2faab6627c46efa104c760d880b69033/pa/UH31359_c5181e0fd0bf2dd97fc554ec92d10eee.jpg',
                'https://img-pa.auto1.com/img2f/aa/2faab6627c46efa104c760d880b69033/pa/UH31359_454e2eca2f36f43fc4e7387d2bb28e58.jpg',
                'https://img-pa.auto1.com/img2f/aa/2faab6627c46efa104c760d880b69033/pa/UH31359_afbb6c8c1dd52d9e45e4f03da0ea39c0.jpg',
                'https://img-pa.auto1.com/img2f/aa/2faab6627c46efa104c760d880b69033/pa/UH31359_d2792977371aa0725d1e7213d51d0e8f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a5806fa-d8db-5374-8126-2f9923f37fc6/1a5806fa-d8db-5374-8126-2f9923f37fc6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89116,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/aa/2faab6627c46efa104c760d880b69033/pa/UH31359_6695023700965b55004e64abd4029943.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a5806fa-d8db-5374-8126-2f9923f37fc6/1a5806fa-d8db-5374-8126-2f9923f37fc6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/aa/2faab6627c46efa104c760d880b69033/pa/UH31359_d9afbb5789c15c0d5572c80bffa59b0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a5806fa-d8db-5374-8126-2f9923f37fc6/1a5806fa-d8db-5374-8126-2f9923f37fc6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/aa/2faab6627c46efa104c760d880b69033/pa/UH31359_5a88f0c4d476a95644772816699e0fa7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a5806fa-d8db-5374-8126-2f9923f37fc6/1a5806fa-d8db-5374-8126-2f9923f37fc6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62821,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/aa/2faab6627c46efa104c760d880b69033/pa/UH31359_3bdaf32b0317c7e1b3e613ef24ce046a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a5806fa-d8db-5374-8126-2f9923f37fc6/1a5806fa-d8db-5374-8126-2f9923f37fc6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/aa/2faab6627c46efa104c760d880b69033/pa/UH31359_d67b5734c89ded4970a2e77906f9bd37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a5806fa-d8db-5374-8126-2f9923f37fc6/1a5806fa-d8db-5374-8126-2f9923f37fc6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/aa/2faab6627c46efa104c760d880b69033/pa/UH31359_4e66b432f50fd9eb9bde873d413f7c15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a5806fa-d8db-5374-8126-2f9923f37fc6/1a5806fa-d8db-5374-8126-2f9923f37fc6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64759,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/aa/2faab6627c46efa104c760d880b69033/pa/UH31359_c5181e0fd0bf2dd97fc554ec92d10eee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a5806fa-d8db-5374-8126-2f9923f37fc6/1a5806fa-d8db-5374-8126-2f9923f37fc6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/aa/2faab6627c46efa104c760d880b69033/pa/UH31359_454e2eca2f36f43fc4e7387d2bb28e58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a5806fa-d8db-5374-8126-2f9923f37fc6/1a5806fa-d8db-5374-8126-2f9923f37fc6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95116,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/aa/2faab6627c46efa104c760d880b69033/pa/UH31359_afbb6c8c1dd52d9e45e4f03da0ea39c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1a5806fa-d8db-5374-8126-2f9923f37fc6/1a5806fa-d8db-5374-8126-2f9923f37fc6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/aa/2faab6627c46efa104c760d880b69033/pa/UH31359_d2792977371aa0725d1e7213d51d0e8f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar F-Pace 25t R-Sport AWD',
 'transmission': 'automatic',
 'trim': 'R-Sport AWD',
 'year': 2019}
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH31359%27 HTTP/1.1" 200 None
2026-03-29 10:36:09 [auto1.de] INFO: Saving data for UH31359: {'created_time': 1774780569.853448, 'last_price_update_time': 1774780569.853458, 'auction_closing_time': 1774885071.0}
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH31359') HTTP/1.1" 204 0
2026-03-29 10:36:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b04275d4-e3e9-5b86-85b9-d3df253cb748 with identifier: EC36111
2026-03-29 10:36:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b04275d4-e3e9-5b86-85b9-d3df253cb748 with identifier: EC36111
2026-03-29 10:36:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b04275d4-e3e9-5b86-85b9-d3df253cb748 with identifier: EC36111 to the API
2026-03-29 10:36:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:32:47Z',
 'fuel_type': 'petrol',
 'id': 'b04275d4-e3e9-5b86-85b9-d3df253cb748',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC36111',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Xsara Picasso',
 'odometer': 114184,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-01-12',
 'seller_name': None,
 'title': 'Citroen Xsara Picasso 1.6 Confort',
 'transmission': 'manual',
 'trim': 'Confort',
 'year': 2006}
2026-03-29 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC36111%27 HTTP/1.1" 200 None
2026-03-29 10:36:10 [auto1.de] INFO: Saving data for EC36111: {'auction_closing_time': 1774884767.0, 'created_time': 1774637510.293763, 'last_price_update_time': 1774780570.302801}
2026-03-29 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC36111') HTTP/1.1" 204 0
2026-03-29 10:36:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:10 [auto1.de] INFO: Found listing with ID: ND21540
2026-03-29 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND21540%27 HTTP/1.1" 200 None
2026-03-29 10:36:10 [auto1.de] INFO: Scrape type for ND21540: 2
2026-03-29 10:36:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 269b91c4-7d5e-5435-9f23-97176b02ee30 with identifier: ND21540
2026-03-29 10:36:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 269b91c4-7d5e-5435-9f23-97176b02ee30 with scrape type 2
2026-03-29 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 269b91c4-7d5e-5435-9f23-97176b02ee30 with scrape type 2
2026-03-29 10:36:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 269b91c4-7d5e-5435-9f23-97176b02ee30, identifier: ND21540
2026-03-29 10:36:10 [auto1.de] INFO: Found listing with ID: GT54138
2026-03-29 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT54138%27 HTTP/1.1" 200 None
2026-03-29 10:36:10 [auto1.de] INFO: Scrape type for GT54138: 1
2026-03-29 10:36:10 [auto1.de] INFO: Found listing with ID: WJ67809
2026-03-29 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ67809%27 HTTP/1.1" 200 None
2026-03-29 10:36:10 [auto1.de] INFO: Scrape type for WJ67809: 2
2026-03-29 10:36:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edda5bae-10ff-5965-bc3a-9a9934a898d0 with identifier: WJ67809
2026-03-29 10:36:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edda5bae-10ff-5965-bc3a-9a9934a898d0 with scrape type 2
2026-03-29 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item edda5bae-10ff-5965-bc3a-9a9934a898d0 with scrape type 2
2026-03-29 10:36:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: edda5bae-10ff-5965-bc3a-9a9934a898d0, identifier: WJ67809
2026-03-29 10:36:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 269b91c4-7d5e-5435-9f23-97176b02ee30 with identifier: ND21540
2026-03-29 10:36:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 269b91c4-7d5e-5435-9f23-97176b02ee30 with identifier: ND21540
2026-03-29 10:36:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 269b91c4-7d5e-5435-9f23-97176b02ee30 with identifier: ND21540 to the API
2026-03-29 10:36:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:05:22Z',
 'fuel_type': 'petrol',
 'id': '269b91c4-7d5e-5435-9f23-97176b02ee30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND21540',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 54799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-25',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI Performance BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTI Performance BlueMotion',
 'year': 2018}
2026-03-29 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND21540%27 HTTP/1.1" 200 None
2026-03-29 10:36:10 [auto1.de] INFO: Saving data for ND21540: {'auction_closing_time': 1774883122.0, 'created_time': 1774550698.89929, 'last_price_update_time': 1774780570.931871}
2026-03-29 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND21540') HTTP/1.1" 204 0
2026-03-29 10:36:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: edda5bae-10ff-5965-bc3a-9a9934a898d0 with identifier: WJ67809
2026-03-29 10:36:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: edda5bae-10ff-5965-bc3a-9a9934a898d0 with identifier: WJ67809
2026-03-29 10:36:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: edda5bae-10ff-5965-bc3a-9a9934a898d0 with identifier: WJ67809 to the API
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 97,
 'expiration_date': '2026-03-30T15:15:06Z',
 'fuel_type': 'petrol',
 'id': 'edda5bae-10ff-5965-bc3a-9a9934a898d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ67809',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Accent',
 'odometer': 97531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-30',
 'seller_name': None,
 'title': 'Hyundai Accent 1.4 GL',
 'transmission': 'manual',
 'trim': 'GL',
 'year': 2007}
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ67809%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [auto1.de] INFO: Saving data for WJ67809: {'auction_closing_time': 1774883706.0, 'created_time': 1774550905.650726, 'last_price_update_time': 1774780571.296729}
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ67809') HTTP/1.1" 204 0
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: XG25622
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG25622%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [auto1.de] INFO: Scrape type for XG25622: 1
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: US93398
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: WY12370
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: GB77683
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: WZ39505
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: YL47006
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: BT97276
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: UJ62660
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: UY36184
2026-03-29 10:36:11 [auto1.de] INFO: Found listing with ID: WE06039
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE06039%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [auto1.de] INFO: Scrape type for WE06039: 2
2026-03-29 10:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bc8e8ad-c754-5775-937f-15973877c749 with identifier: WE06039
2026-03-29 10:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bc8e8ad-c754-5775-937f-15973877c749 with scrape type 2
2026-03-29 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bc8e8ad-c754-5775-937f-15973877c749 with scrape type 2
2026-03-29 10:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7bc8e8ad-c754-5775-937f-15973877c749, identifier: WE06039
2026-03-29 10:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HB21625/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 490993ff-1382-5b73-a2b8-32496728408b with identifier: BE23086
2026-03-29 10:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 490993ff-1382-5b73-a2b8-32496728408b with scrape type 1
2026-03-29 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 490993ff-1382-5b73-a2b8-32496728408b
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F5d%252F325daa39623d6fdde719e31d52eab908%252Fpa%252FBE23086_cfa7e62fc98c0cf86cc7cebb5e5f1178.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/5d/325daa39623d6fdde719e31d52eab908/pa/BE23086_cfa7e62fc98c0cf86cc7cebb5e5f1178.jpg already downloaded
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F5d%252F325daa39623d6fdde719e31d52eab908%252Fpa%252FBE23086_7b62922ae33fc44869a3b875f880e6bc.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/5d/325daa39623d6fdde719e31d52eab908/pa/BE23086_7b62922ae33fc44869a3b875f880e6bc.jpg already downloaded
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F5d%252F325daa39623d6fdde719e31d52eab908%252Fpa%252FBE23086_416c6bb98c02f9a515ea50cee5421283.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/5d/325daa39623d6fdde719e31d52eab908/pa/BE23086_416c6bb98c02f9a515ea50cee5421283.jpg already downloaded
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F5d%252F325daa39623d6fdde719e31d52eab908%252Fpa%252FBE23086_d8038c0ada5b639c98c0939d996e92ef.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/5d/325daa39623d6fdde719e31d52eab908/pa/BE23086_d8038c0ada5b639c98c0939d996e92ef.jpg already downloaded
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F5d%252F325daa39623d6fdde719e31d52eab908%252Fpa%252FBE23086_3c7ae802e1ad85d120408a19f08d5f34.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/5d/325daa39623d6fdde719e31d52eab908/pa/BE23086_3c7ae802e1ad85d120408a19f08d5f34.jpg already downloaded
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F5d%252F325daa39623d6fdde719e31d52eab908%252Fpa%252FBE23086_40b8dc4a9330d5750c195273823e6ef0.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/5d/325daa39623d6fdde719e31d52eab908/pa/BE23086_40b8dc4a9330d5750c195273823e6ef0.jpg already downloaded
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F5d%252F325daa39623d6fdde719e31d52eab908%252Fpa%252FBE23086_f50e0767baa0331e01187890778b1918.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/5d/325daa39623d6fdde719e31d52eab908/pa/BE23086_f50e0767baa0331e01187890778b1918.jpg already downloaded
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F5d%252F325daa39623d6fdde719e31d52eab908%252Fpa%252FBE23086_517bf974850be240e9bc719c22f202a2.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/5d/325daa39623d6fdde719e31d52eab908/pa/BE23086_517bf974850be240e9bc719c22f202a2.jpg already downloaded
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F5d%252F325daa39623d6fdde719e31d52eab908%252Fpa%252FBE23086_322982be98dcfe932a1c76929f896bd8.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/5d/325daa39623d6fdde719e31d52eab908/pa/BE23086_322982be98dcfe932a1c76929f896bd8.jpg already downloaded
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F5d%252F325daa39623d6fdde719e31d52eab908%252Fpa%252FBE23086_ddf552004c9dec01f203e8232fae0810.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/5d/325daa39623d6fdde719e31d52eab908/pa/BE23086_ddf552004c9dec01f203e8232fae0810.jpg already downloaded
2026-03-29 10:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 490993ff-1382-5b73-a2b8-32496728408b, identifier: BE23086
2026-03-29 10:36:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7bc8e8ad-c754-5775-937f-15973877c749 with identifier: WE06039
2026-03-29 10:36:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7bc8e8ad-c754-5775-937f-15973877c749 with identifier: WE06039
2026-03-29 10:36:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7bc8e8ad-c754-5775-937f-15973877c749 with identifier: WE06039 to the API
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:38:59Z',
 'fuel_type': 'petrol',
 'id': '7bc8e8ad-c754-5775-937f-15973877c749',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE06039',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 2861,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-22',
 'seller_name': None,
 'title': 'Hyundai i30 1.5 T-GDI Mild-Hybrid N Line',
 'transmission': 'automatic',
 'trim': 'N Line',
 'year': 2024}
2026-03-29 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE06039%27 HTTP/1.1" 200 None
2026-03-29 10:36:12 [auto1.de] INFO: Saving data for WE06039: {'auction_closing_time': 1774885139.0, 'created_time': 1774118768.089242, 'last_price_update_time': 1774780572.097804}
2026-03-29 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE06039') HTTP/1.1" 204 0
2026-03-29 10:36:12 [auto1.de] INFO: Found listing with ID: DN18269
2026-03-29 10:36:12 [auto1.de] INFO: Found listing with ID: WK49951
2026-03-29 10:36:12 [auto1.de] INFO: Found listing with ID: VX95412
2026-03-29 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX95412%27 HTTP/1.1" 200 None
2026-03-29 10:36:12 [auto1.de] INFO: Scrape type for VX95412: 2
2026-03-29 10:36:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d043364-9e80-52b4-8239-f5b3f38a8d61 with identifier: VX95412
2026-03-29 10:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d043364-9e80-52b4-8239-f5b3f38a8d61 with scrape type 2
2026-03-29 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d043364-9e80-52b4-8239-f5b3f38a8d61 with scrape type 2
2026-03-29 10:36:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d043364-9e80-52b4-8239-f5b3f38a8d61, identifier: VX95412
2026-03-29 10:36:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 490993ff-1382-5b73-a2b8-32496728408b with identifier: BE23086
2026-03-29 10:36:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 490993ff-1382-5b73-a2b8-32496728408b with identifier: BE23086
2026-03-29 10:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 490993ff-1382-5b73-a2b8-32496728408b with identifier: BE23086 to the API
2026-03-29 10:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BE23086>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:30:52Z',
 'fuel_type': 'diesel',
 'id': '490993ff-1382-5b73-a2b8-32496728408b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE23086',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 208686,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img32/5d/325daa39623d6fdde719e31d52eab908/pa/BE23086_cfa7e62fc98c0cf86cc7cebb5e5f1178.jpg',
                'https://img-pa.auto1.com/img32/5d/325daa39623d6fdde719e31d52eab908/pa/BE23086_7b62922ae33fc44869a3b875f880e6bc.jpg',
                'https://img-pa.auto1.com/img32/5d/325daa39623d6fdde719e31d52eab908/pa/BE23086_416c6bb98c02f9a515ea50cee5421283.jpg',
                'https://img-pa.auto1.com/img32/5d/325daa39623d6fdde719e31d52eab908/pa/BE23086_d8038c0ada5b639c98c0939d996e92ef.jpg',
                'https://img-pa.auto1.com/img32/5d/325daa39623d6fdde719e31d52eab908/pa/BE23086_3c7ae802e1ad85d120408a19f08d5f34.jpg',
                'https://img-pa.auto1.com/img32/5d/325daa39623d6fdde719e31d52eab908/pa/BE23086_40b8dc4a9330d5750c195273823e6ef0.jpg',
                'https://img-pa.auto1.com/img32/5d/325daa39623d6fdde719e31d52eab908/pa/BE23086_f50e0767baa0331e01187890778b1918.jpg',
                'https://img-pa.auto1.com/img32/5d/325daa39623d6fdde719e31d52eab908/pa/BE23086_517bf974850be240e9bc719c22f202a2.jpg',
                'https://img-pa.auto1.com/img32/5d/325daa39623d6fdde719e31d52eab908/pa/BE23086_322982be98dcfe932a1c76929f896bd8.jpg',
                'https://img-pa.auto1.com/img32/5d/325daa39623d6fdde719e31d52eab908/pa/BE23086_ddf552004c9dec01f203e8232fae0810.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490993ff-1382-5b73-a2b8-32496728408b/490993ff-1382-5b73-a2b8-32496728408b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88587,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/5d/325daa39623d6fdde719e31d52eab908/pa/BE23086_cfa7e62fc98c0cf86cc7cebb5e5f1178.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490993ff-1382-5b73-a2b8-32496728408b/490993ff-1382-5b73-a2b8-32496728408b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88587,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/5d/325daa39623d6fdde719e31d52eab908/pa/BE23086_7b62922ae33fc44869a3b875f880e6bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490993ff-1382-5b73-a2b8-32496728408b/490993ff-1382-5b73-a2b8-32496728408b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/5d/325daa39623d6fdde719e31d52eab908/pa/BE23086_416c6bb98c02f9a515ea50cee5421283.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490993ff-1382-5b73-a2b8-32496728408b/490993ff-1382-5b73-a2b8-32496728408b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88587,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/5d/325daa39623d6fdde719e31d52eab908/pa/BE23086_d8038c0ada5b639c98c0939d996e92ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490993ff-1382-5b73-a2b8-32496728408b/490993ff-1382-5b73-a2b8-32496728408b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81237,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/5d/325daa39623d6fdde719e31d52eab908/pa/BE23086_3c7ae802e1ad85d120408a19f08d5f34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490993ff-1382-5b73-a2b8-32496728408b/490993ff-1382-5b73-a2b8-32496728408b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/5d/325daa39623d6fdde719e31d52eab908/pa/BE23086_40b8dc4a9330d5750c195273823e6ef0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490993ff-1382-5b73-a2b8-32496728408b/490993ff-1382-5b73-a2b8-32496728408b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/5d/325daa39623d6fdde719e31d52eab908/pa/BE23086_f50e0767baa0331e01187890778b1918.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490993ff-1382-5b73-a2b8-32496728408b/490993ff-1382-5b73-a2b8-32496728408b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/5d/325daa39623d6fdde719e31d52eab908/pa/BE23086_517bf974850be240e9bc719c22f202a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490993ff-1382-5b73-a2b8-32496728408b/490993ff-1382-5b73-a2b8-32496728408b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/5d/325daa39623d6fdde719e31d52eab908/pa/BE23086_322982be98dcfe932a1c76929f896bd8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_490993ff-1382-5b73-a2b8-32496728408b/490993ff-1382-5b73-a2b8-32496728408b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/5d/325daa39623d6fdde719e31d52eab908/pa/BE23086_ddf552004c9dec01f203e8232fae0810.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350 d 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2017}
2026-03-29 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE23086%27 HTTP/1.1" 200 None
2026-03-29 10:36:12 [auto1.de] INFO: Saving data for BE23086: {'created_time': 1774780572.657639, 'last_price_update_time': 1774780572.657651, 'auction_closing_time': 1774884652.0}
2026-03-29 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE23086') HTTP/1.1" 204 0
2026-03-29 10:36:12 [auto1.de] INFO: Found listing with ID: JK20630
2026-03-29 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK20630%27 HTTP/1.1" 200 None
2026-03-29 10:36:12 [auto1.de] INFO: Scrape type for JK20630: 2
2026-03-29 10:36:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac534faf-be91-59c9-813a-d0b38ca4e99a with identifier: JK20630
2026-03-29 10:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac534faf-be91-59c9-813a-d0b38ca4e99a with scrape type 2
2026-03-29 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac534faf-be91-59c9-813a-d0b38ca4e99a with scrape type 2
2026-03-29 10:36:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac534faf-be91-59c9-813a-d0b38ca4e99a, identifier: JK20630
2026-03-29 10:36:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d043364-9e80-52b4-8239-f5b3f38a8d61 with identifier: VX95412
2026-03-29 10:36:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d043364-9e80-52b4-8239-f5b3f38a8d61 with identifier: VX95412
2026-03-29 10:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d043364-9e80-52b4-8239-f5b3f38a8d61 with identifier: VX95412 to the API
2026-03-29 10:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:19:47Z',
 'fuel_type': 'diesel',
 'id': '0d043364-9e80-52b4-8239-f5b3f38a8d61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX95412',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 88817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-27',
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi Allure L2',
 'transmission': 'manual',
 'trim': 'Allure L2',
 'year': 2021}
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX95412%27 HTTP/1.1" 200 None
2026-03-29 10:36:13 [auto1.de] INFO: Saving data for VX95412: {'auction_closing_time': 1774883987.0, 'created_time': 1773301153.584986, 'last_price_update_time': 1774780573.123793}
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX95412') HTTP/1.1" 204 0
2026-03-29 10:36:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac534faf-be91-59c9-813a-d0b38ca4e99a with identifier: JK20630
2026-03-29 10:36:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac534faf-be91-59c9-813a-d0b38ca4e99a with identifier: JK20630
2026-03-29 10:36:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac534faf-be91-59c9-813a-d0b38ca4e99a with identifier: JK20630 to the API
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:15:00Z',
 'fuel_type': 'petrol',
 'id': 'ac534faf-be91-59c9-813a-d0b38ca4e99a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK20630',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Arteon',
 'odometer': 87785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-17',
 'seller_name': None,
 'title': 'Volkswagen Arteon 2.0 TSI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2019}
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK20630%27 HTTP/1.1" 200 None
2026-03-29 10:36:13 [auto1.de] INFO: Saving data for JK20630: {'auction_closing_time': 1774883700.0, 'created_time': 1774379501.062065, 'last_price_update_time': 1774780573.48883}
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JK20630') HTTP/1.1" 204 0
2026-03-29 10:36:13 [auto1.de] INFO: Found listing with ID: NP40069
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP40069%27 HTTP/1.1" 200 None
2026-03-29 10:36:13 [auto1.de] INFO: Scrape type for NP40069: 2
2026-03-29 10:36:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c91aa04-110b-5083-a79b-ccaa51ae72a4 with identifier: NP40069
2026-03-29 10:36:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c91aa04-110b-5083-a79b-ccaa51ae72a4 with scrape type 2
2026-03-29 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c91aa04-110b-5083-a79b-ccaa51ae72a4 with scrape type 2
2026-03-29 10:36:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c91aa04-110b-5083-a79b-ccaa51ae72a4, identifier: NP40069
2026-03-29 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NB51359/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MZ37823> (referer: https://www.auto1.com/v1/car-details-view/MZ37823/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:13 [auto1.de] INFO: Found listing with ID: UR84816
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR84816%27 HTTP/1.1" 200 None
2026-03-29 10:36:13 [auto1.de] INFO: Scrape type for UR84816: 2
2026-03-29 10:36:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86eefe12-1b3e-59e1-91d8-5fc30edf9243 with identifier: UR84816
2026-03-29 10:36:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86eefe12-1b3e-59e1-91d8-5fc30edf9243 with scrape type 2
2026-03-29 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86eefe12-1b3e-59e1-91d8-5fc30edf9243 with scrape type 2
2026-03-29 10:36:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 86eefe12-1b3e-59e1-91d8-5fc30edf9243, identifier: UR84816
2026-03-29 10:36:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c91aa04-110b-5083-a79b-ccaa51ae72a4 with identifier: NP40069
2026-03-29 10:36:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c91aa04-110b-5083-a79b-ccaa51ae72a4 with identifier: NP40069
2026-03-29 10:36:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c91aa04-110b-5083-a79b-ccaa51ae72a4 with identifier: NP40069 to the API
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:41:34Z',
 'fuel_type': 'petrol',
 'id': '6c91aa04-110b-5083-a79b-ccaa51ae72a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP40069',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC70',
 'odometer': 344180,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-06-05',
 'seller_name': None,
 'title': 'Volvo XC70 2.4 T AWD Cross Country',
 'transmission': 'automatic',
 'trim': 'AWD Cross Country',
 'year': 2001}
2026-03-29 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP40069%27 HTTP/1.1" 200 None
2026-03-29 10:36:14 [auto1.de] INFO: Saving data for NP40069: {'auction_closing_time': 1774885294.0, 'created_time': 1773861513.323761, 'last_price_update_time': 1774780574.086337}
2026-03-29 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NP40069') HTTP/1.1" 204 0
2026-03-29 10:36:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BS02635/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TT55225> (referer: https://www.auto1.com/v1/car-details-view/TT55225/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RR70760/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VE07121/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 86eefe12-1b3e-59e1-91d8-5fc30edf9243 with identifier: UR84816
2026-03-29 10:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 86eefe12-1b3e-59e1-91d8-5fc30edf9243 with identifier: UR84816
2026-03-29 10:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 86eefe12-1b3e-59e1-91d8-5fc30edf9243 with identifier: UR84816 to the API
2026-03-29 10:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 174,
 'expiration_date': '2026-03-30T15:06:17Z',
 'fuel_type': 'diesel',
 'id': '86eefe12-1b3e-59e1-91d8-5fc30edf9243',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR84816',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia',
 'odometer': 96158,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-29',
 'seller_name': None,
 'title': 'Opel Insignia 2.0 CDTI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2021}
2026-03-29 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR84816%27 HTTP/1.1" 200 None
2026-03-29 10:36:14 [auto1.de] INFO: Saving data for UR84816: {'auction_closing_time': 1774883177.0, 'created_time': 1774550947.252458, 'last_price_update_time': 1774780574.461525}
2026-03-29 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UR84816') HTTP/1.1" 204 0
2026-03-29 10:36:14 [auto1.de] INFO: Found listing with ID: AE04688
2026-03-29 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE04688%27 HTTP/1.1" 200 None
2026-03-29 10:36:14 [auto1.de] INFO: Scrape type for AE04688: 2
2026-03-29 10:36:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cd0abca-ab67-5885-acaa-04ee2974186f with identifier: AE04688
2026-03-29 10:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cd0abca-ab67-5885-acaa-04ee2974186f with scrape type 2
2026-03-29 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cd0abca-ab67-5885-acaa-04ee2974186f with scrape type 2
2026-03-29 10:36:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0cd0abca-ab67-5885-acaa-04ee2974186f, identifier: AE04688
2026-03-29 10:36:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:14 [auto1.de] INFO: Found listing with ID: UF70247
2026-03-29 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF70247%27 HTTP/1.1" 200 None
2026-03-29 10:36:14 [auto1.de] INFO: Scrape type for UF70247: 2
2026-03-29 10:36:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3cd8fe5-6cd7-5631-88cd-0531e9045579 with identifier: UF70247
2026-03-29 10:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3cd8fe5-6cd7-5631-88cd-0531e9045579 with scrape type 2
2026-03-29 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3cd8fe5-6cd7-5631-88cd-0531e9045579 with scrape type 2
2026-03-29 10:36:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b3cd8fe5-6cd7-5631-88cd-0531e9045579, identifier: UF70247
2026-03-29 10:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0cd0abca-ab67-5885-acaa-04ee2974186f with identifier: AE04688
2026-03-29 10:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0cd0abca-ab67-5885-acaa-04ee2974186f with identifier: AE04688
2026-03-29 10:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0cd0abca-ab67-5885-acaa-04ee2974186f with identifier: AE04688 to the API
2026-03-29 10:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:24:59Z',
 'fuel_type': 'petrol',
 'id': '0cd0abca-ab67-5885-acaa-04ee2974186f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE04688',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 87476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-29',
 'seller_name': None,
 'title': 'Honda Civic 1.0 VTEC Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2017}
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE04688%27 HTTP/1.1" 200 None
2026-03-29 10:36:15 [auto1.de] INFO: Saving data for AE04688: {'auction_closing_time': 1774884299.0, 'created_time': 1773517648.634196, 'last_price_update_time': 1774780575.018303}
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE04688') HTTP/1.1" 204 0
2026-03-29 10:36:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b3cd8fe5-6cd7-5631-88cd-0531e9045579 with identifier: UF70247
2026-03-29 10:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b3cd8fe5-6cd7-5631-88cd-0531e9045579 with identifier: UF70247
2026-03-29 10:36:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b3cd8fe5-6cd7-5631-88cd-0531e9045579 with identifier: UF70247 to the API
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-30T15:52:48Z',
 'fuel_type': 'petrol',
 'id': 'b3cd8fe5-6cd7-5631-88cd-0531e9045579',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF70247',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 75807,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-22',
 'seller_name': None,
 'title': 'Renault Megane 1.2 TCe Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2017}
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF70247%27 HTTP/1.1" 200 None
2026-03-29 10:36:15 [auto1.de] INFO: Saving data for UF70247: {'auction_closing_time': 1774885968.0, 'created_time': 1773224305.26304, 'last_price_update_time': 1774780575.369679}
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UF70247') HTTP/1.1" 204 0
2026-03-29 10:36:15 [auto1.de] INFO: Found listing with ID: HG95875
2026-03-29 10:36:15 [auto1.de] INFO: Found listing with ID: VW68690
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW68690%27 HTTP/1.1" 200 None
2026-03-29 10:36:15 [auto1.de] INFO: Scrape type for VW68690: 2
2026-03-29 10:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0afdcaa-e7a8-5108-ba5f-1cd412738d42 with identifier: VW68690
2026-03-29 10:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0afdcaa-e7a8-5108-ba5f-1cd412738d42 with scrape type 2
2026-03-29 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0afdcaa-e7a8-5108-ba5f-1cd412738d42 with scrape type 2
2026-03-29 10:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d0afdcaa-e7a8-5108-ba5f-1cd412738d42, identifier: VW68690
2026-03-29 10:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13002385-ccd3-55ab-b8a9-6b4548c571a4 with identifier: MZ37823
2026-03-29 10:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13002385-ccd3-55ab-b8a9-6b4548c571a4 with scrape type 1
2026-03-29 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 13002385-ccd3-55ab-b8a9-6b4548c571a4
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fe6%252Fe8e620fed17971d117b9da0db2b9e70f%252Fpa%252FMZ37823_660c6c8078109c57f695bdc6a0231cf4.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/e6/e8e620fed17971d117b9da0db2b9e70f/pa/MZ37823_660c6c8078109c57f695bdc6a0231cf4.jpg already downloaded
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fe6%252Fe8e620fed17971d117b9da0db2b9e70f%252Fpa%252FMZ37823_ca9ced0e978d0f584bfbdc189fb546ae.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/e6/e8e620fed17971d117b9da0db2b9e70f/pa/MZ37823_ca9ced0e978d0f584bfbdc189fb546ae.jpg already downloaded
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fe6%252Fe8e620fed17971d117b9da0db2b9e70f%252Fpa%252FMZ37823_242cb4a4b9aea013b32b95791fbd1944.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/e6/e8e620fed17971d117b9da0db2b9e70f/pa/MZ37823_242cb4a4b9aea013b32b95791fbd1944.jpg already downloaded
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fe6%252Fe8e620fed17971d117b9da0db2b9e70f%252Fpa%252FMZ37823_cc5618d916649a18bd70d6f97e2892c9.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/e6/e8e620fed17971d117b9da0db2b9e70f/pa/MZ37823_cc5618d916649a18bd70d6f97e2892c9.jpg already downloaded
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fe6%252Fe8e620fed17971d117b9da0db2b9e70f%252Fpa%252FMZ37823_5d1fa6f99762aad6022074ec7f9ef183.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/e6/e8e620fed17971d117b9da0db2b9e70f/pa/MZ37823_5d1fa6f99762aad6022074ec7f9ef183.jpg already downloaded
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fe6%252Fe8e620fed17971d117b9da0db2b9e70f%252Fpa%252FMZ37823_3b29f08b4378f9bc14eb3d6742e1ca9d.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/e6/e8e620fed17971d117b9da0db2b9e70f/pa/MZ37823_3b29f08b4378f9bc14eb3d6742e1ca9d.jpg already downloaded
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fe6%252Fe8e620fed17971d117b9da0db2b9e70f%252Fpa%252FMZ37823_f6139763ccf1e6ca4b88d21943234c83.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/e6/e8e620fed17971d117b9da0db2b9e70f/pa/MZ37823_f6139763ccf1e6ca4b88d21943234c83.jpg already downloaded
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fe6%252Fe8e620fed17971d117b9da0db2b9e70f%252Fpa%252FMZ37823_8220ab0ad6cc398faaffe5fc40bd6eaf.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/e6/e8e620fed17971d117b9da0db2b9e70f/pa/MZ37823_8220ab0ad6cc398faaffe5fc40bd6eaf.jpg already downloaded
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fe6%252Fe8e620fed17971d117b9da0db2b9e70f%252Fpa%252FMZ37823_fe8f16a8549734fe8bcdc859942ac857.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/e6/e8e620fed17971d117b9da0db2b9e70f/pa/MZ37823_fe8f16a8549734fe8bcdc859942ac857.jpg already downloaded
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fe6%252Fe8e620fed17971d117b9da0db2b9e70f%252Fpa%252FMZ37823_c1772da31796f7754b98627d95fb14fc.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/e6/e8e620fed17971d117b9da0db2b9e70f/pa/MZ37823_c1772da31796f7754b98627d95fb14fc.jpg already downloaded
2026-03-29 10:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13002385-ccd3-55ab-b8a9-6b4548c571a4, identifier: MZ37823
2026-03-29 10:36:15 [auto1.de] INFO: Found listing with ID: XA86799
2026-03-29 10:36:15 [auto1.de] INFO: Found listing with ID: SU99742
2026-03-29 10:36:15 [auto1.de] INFO: Found listing with ID: ZE87532
2026-03-29 10:36:15 [auto1.de] INFO: Found listing with ID: ZJ67042
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ67042%27 HTTP/1.1" 200 None
2026-03-29 10:36:15 [auto1.de] INFO: Scrape type for ZJ67042: 1
2026-03-29 10:36:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d0afdcaa-e7a8-5108-ba5f-1cd412738d42 with identifier: VW68690
2026-03-29 10:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d0afdcaa-e7a8-5108-ba5f-1cd412738d42 with identifier: VW68690
2026-03-29 10:36:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d0afdcaa-e7a8-5108-ba5f-1cd412738d42 with identifier: VW68690 to the API
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:22:52Z',
 'fuel_type': 'petrol',
 'id': 'd0afdcaa-e7a8-5108-ba5f-1cd412738d42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW68690',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Linea',
 'odometer': 194308,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-25',
 'seller_name': None,
 'title': 'Fiat Linea 1.4 Turbo Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2008}
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW68690%27 HTTP/1.1" 200 None
2026-03-29 10:36:16 [auto1.de] INFO: Saving data for VW68690: {'auction_closing_time': 1774884172.0, 'created_time': 1774550805.083777, 'last_price_update_time': 1774780576.135221}
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW68690') HTTP/1.1" 204 0
2026-03-29 10:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13002385-ccd3-55ab-b8a9-6b4548c571a4 with identifier: MZ37823
2026-03-29 10:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13002385-ccd3-55ab-b8a9-6b4548c571a4 with identifier: MZ37823
2026-03-29 10:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13002385-ccd3-55ab-b8a9-6b4548c571a4 with identifier: MZ37823 to the API
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MZ37823>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 325,
 'expiration_date': '2026-03-30T15:36:45Z',
 'fuel_type': 'diesel',
 'id': '13002385-ccd3-55ab-b8a9-6b4548c571a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ37823',
 'listing': 'auction',
 'location': 'DE, Saarlouis',
 'make': 'Audi',
 'model': 'A7 Sportback',
 'odometer': 222436,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imge8/e6/e8e620fed17971d117b9da0db2b9e70f/pa/MZ37823_660c6c8078109c57f695bdc6a0231cf4.jpg',
                'https://img-pa.auto1.com/imge8/e6/e8e620fed17971d117b9da0db2b9e70f/pa/MZ37823_ca9ced0e978d0f584bfbdc189fb546ae.jpg',
                'https://img-pa.auto1.com/imge8/e6/e8e620fed17971d117b9da0db2b9e70f/pa/MZ37823_242cb4a4b9aea013b32b95791fbd1944.jpg',
                'https://img-pa.auto1.com/imge8/e6/e8e620fed17971d117b9da0db2b9e70f/pa/MZ37823_cc5618d916649a18bd70d6f97e2892c9.jpg',
                'https://img-pa.auto1.com/imge8/e6/e8e620fed17971d117b9da0db2b9e70f/pa/MZ37823_5d1fa6f99762aad6022074ec7f9ef183.jpg',
                'https://img-pa.auto1.com/imge8/e6/e8e620fed17971d117b9da0db2b9e70f/pa/MZ37823_3b29f08b4378f9bc14eb3d6742e1ca9d.jpg',
                'https://img-pa.auto1.com/imge8/e6/e8e620fed17971d117b9da0db2b9e70f/pa/MZ37823_f6139763ccf1e6ca4b88d21943234c83.jpg',
                'https://img-pa.auto1.com/imge8/e6/e8e620fed17971d117b9da0db2b9e70f/pa/MZ37823_8220ab0ad6cc398faaffe5fc40bd6eaf.jpg',
                'https://img-pa.auto1.com/imge8/e6/e8e620fed17971d117b9da0db2b9e70f/pa/MZ37823_fe8f16a8549734fe8bcdc859942ac857.jpg',
                'https://img-pa.auto1.com/imge8/e6/e8e620fed17971d117b9da0db2b9e70f/pa/MZ37823_c1772da31796f7754b98627d95fb14fc.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13002385-ccd3-55ab-b8a9-6b4548c571a4/13002385-ccd3-55ab-b8a9-6b4548c571a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87587,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/e6/e8e620fed17971d117b9da0db2b9e70f/pa/MZ37823_660c6c8078109c57f695bdc6a0231cf4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13002385-ccd3-55ab-b8a9-6b4548c571a4/13002385-ccd3-55ab-b8a9-6b4548c571a4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/e6/e8e620fed17971d117b9da0db2b9e70f/pa/MZ37823_ca9ced0e978d0f584bfbdc189fb546ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13002385-ccd3-55ab-b8a9-6b4548c571a4/13002385-ccd3-55ab-b8a9-6b4548c571a4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/e6/e8e620fed17971d117b9da0db2b9e70f/pa/MZ37823_242cb4a4b9aea013b32b95791fbd1944.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13002385-ccd3-55ab-b8a9-6b4548c571a4/13002385-ccd3-55ab-b8a9-6b4548c571a4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/e6/e8e620fed17971d117b9da0db2b9e70f/pa/MZ37823_cc5618d916649a18bd70d6f97e2892c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13002385-ccd3-55ab-b8a9-6b4548c571a4/13002385-ccd3-55ab-b8a9-6b4548c571a4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74564,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/e6/e8e620fed17971d117b9da0db2b9e70f/pa/MZ37823_5d1fa6f99762aad6022074ec7f9ef183.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13002385-ccd3-55ab-b8a9-6b4548c571a4/13002385-ccd3-55ab-b8a9-6b4548c571a4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68839,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/e6/e8e620fed17971d117b9da0db2b9e70f/pa/MZ37823_3b29f08b4378f9bc14eb3d6742e1ca9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13002385-ccd3-55ab-b8a9-6b4548c571a4/13002385-ccd3-55ab-b8a9-6b4548c571a4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59547,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/e6/e8e620fed17971d117b9da0db2b9e70f/pa/MZ37823_f6139763ccf1e6ca4b88d21943234c83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13002385-ccd3-55ab-b8a9-6b4548c571a4/13002385-ccd3-55ab-b8a9-6b4548c571a4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/e6/e8e620fed17971d117b9da0db2b9e70f/pa/MZ37823_8220ab0ad6cc398faaffe5fc40bd6eaf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13002385-ccd3-55ab-b8a9-6b4548c571a4/13002385-ccd3-55ab-b8a9-6b4548c571a4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/e6/e8e620fed17971d117b9da0db2b9e70f/pa/MZ37823_fe8f16a8549734fe8bcdc859942ac857.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13002385-ccd3-55ab-b8a9-6b4548c571a4/13002385-ccd3-55ab-b8a9-6b4548c571a4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77876,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/e6/e8e620fed17971d117b9da0db2b9e70f/pa/MZ37823_c1772da31796f7754b98627d95fb14fc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A7 Sportback 3.0 V6 TDI quattro Competition',
 'transmission': 'automatic',
 'trim': 'quattro Competition',
 'year': 2017}
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ37823%27 HTTP/1.1" 200 None
2026-03-29 10:36:16 [auto1.de] INFO: Saving data for MZ37823: {'created_time': 1774780576.584183, 'last_price_update_time': 1774780576.584198, 'auction_closing_time': 1774885005.0}
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ37823') HTTP/1.1" 204 0
2026-03-29 10:36:16 [auto1.de] INFO: Found listing with ID: NX61710
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX61710%27 HTTP/1.1" 200 None
2026-03-29 10:36:16 [auto1.de] INFO: Scrape type for NX61710: 2
2026-03-29 10:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d33f7a4-8524-5f2e-ae83-bc4fa3100e4f with identifier: NX61710
2026-03-29 10:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d33f7a4-8524-5f2e-ae83-bc4fa3100e4f with scrape type 2
2026-03-29 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d33f7a4-8524-5f2e-ae83-bc4fa3100e4f with scrape type 2
2026-03-29 10:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d33f7a4-8524-5f2e-ae83-bc4fa3100e4f, identifier: NX61710
2026-03-29 10:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JY14465> (referer: https://www.auto1.com/v1/car-details-view/JY14465/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd5501a3-67a5-5eb0-a85a-2c82d3a3068f with identifier: TT55225
2026-03-29 10:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd5501a3-67a5-5eb0-a85a-2c82d3a3068f with scrape type 1
2026-03-29 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fd5501a3-67a5-5eb0-a85a-2c82d3a3068f
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fd1%252Fcbd157d14b2060c41da25b1123652ac9%252Fpa%252FTT55225_972d77027ee3b6758210da8b58c3aa3d.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/d1/cbd157d14b2060c41da25b1123652ac9/pa/TT55225_972d77027ee3b6758210da8b58c3aa3d.jpg already downloaded
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fd1%252Fcbd157d14b2060c41da25b1123652ac9%252Fpa%252FTT55225_190bbff15d888e10cd2e9e935e0f741a.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/d1/cbd157d14b2060c41da25b1123652ac9/pa/TT55225_190bbff15d888e10cd2e9e935e0f741a.jpg already downloaded
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fd1%252Fcbd157d14b2060c41da25b1123652ac9%252Fpa%252FTT55225_95dde21d3ebbcad107622294a5d8d69b.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/d1/cbd157d14b2060c41da25b1123652ac9/pa/TT55225_95dde21d3ebbcad107622294a5d8d69b.jpg already downloaded
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fd1%252Fcbd157d14b2060c41da25b1123652ac9%252Fpa%252FTT55225_b31cac88e48e299788423c1b167356ee.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/d1/cbd157d14b2060c41da25b1123652ac9/pa/TT55225_b31cac88e48e299788423c1b167356ee.jpg already downloaded
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fd1%252Fcbd157d14b2060c41da25b1123652ac9%252Fpa%252FTT55225_eb5c2b4080c58dd0fb7737ac29e8702e.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/d1/cbd157d14b2060c41da25b1123652ac9/pa/TT55225_eb5c2b4080c58dd0fb7737ac29e8702e.jpg already downloaded
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fd1%252Fcbd157d14b2060c41da25b1123652ac9%252Fpa%252FTT55225_a2f54d67e18ce8188fc14296a95d5e88.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/d1/cbd157d14b2060c41da25b1123652ac9/pa/TT55225_a2f54d67e18ce8188fc14296a95d5e88.jpg already downloaded
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fd1%252Fcbd157d14b2060c41da25b1123652ac9%252Fpa%252FTT55225_dde01cd63156f2598c51e518dd3d6d8f.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/d1/cbd157d14b2060c41da25b1123652ac9/pa/TT55225_dde01cd63156f2598c51e518dd3d6d8f.jpg already downloaded
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fd1%252Fcbd157d14b2060c41da25b1123652ac9%252Fpa%252FTT55225_31a8a73f7509eb7be3e3825c67602073.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/d1/cbd157d14b2060c41da25b1123652ac9/pa/TT55225_31a8a73f7509eb7be3e3825c67602073.jpg already downloaded
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fd1%252Fcbd157d14b2060c41da25b1123652ac9%252Fpa%252FTT55225_02c2527c2daf685e84d9d6d93e9fa58a.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/d1/cbd157d14b2060c41da25b1123652ac9/pa/TT55225_02c2527c2daf685e84d9d6d93e9fa58a.jpg already downloaded
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fd1%252Fcbd157d14b2060c41da25b1123652ac9%252Fpa%252FTT55225_af4e8f4a5522dd42637e8e49737feedb.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/d1/cbd157d14b2060c41da25b1123652ac9/pa/TT55225_af4e8f4a5522dd42637e8e49737feedb.jpg already downloaded
2026-03-29 10:36:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd5501a3-67a5-5eb0-a85a-2c82d3a3068f, identifier: TT55225
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: JY35599
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: PT45615
2026-03-29 10:36:17 [auto1.de] INFO: Found listing with ID: JA40486
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA40486%27 HTTP/1.1" 200 None
2026-03-29 10:36:17 [auto1.de] INFO: Scrape type for JA40486: 2
2026-03-29 10:36:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e0d4bcb-12b2-51ad-bd2b-67047066796f with identifier: JA40486
2026-03-29 10:36:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e0d4bcb-12b2-51ad-bd2b-67047066796f with scrape type 2
2026-03-29 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e0d4bcb-12b2-51ad-bd2b-67047066796f with scrape type 2
2026-03-29 10:36:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e0d4bcb-12b2-51ad-bd2b-67047066796f, identifier: JA40486
2026-03-29 10:36:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d33f7a4-8524-5f2e-ae83-bc4fa3100e4f with identifier: NX61710
2026-03-29 10:36:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d33f7a4-8524-5f2e-ae83-bc4fa3100e4f with identifier: NX61710
2026-03-29 10:36:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d33f7a4-8524-5f2e-ae83-bc4fa3100e4f with identifier: NX61710 to the API
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:49:27Z',
 'fuel_type': 'petrol',
 'id': '7d33f7a4-8524-5f2e-ae83-bc4fa3100e4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX61710',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 161487,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-01',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2008}
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX61710%27 HTTP/1.1" 200 None
2026-03-29 10:36:17 [auto1.de] INFO: Saving data for NX61710: {'auction_closing_time': 1774885767.0, 'created_time': 1773775381.682167, 'last_price_update_time': 1774780577.474317}
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX61710') HTTP/1.1" 204 0
2026-03-29 10:36:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd5501a3-67a5-5eb0-a85a-2c82d3a3068f with identifier: TT55225
2026-03-29 10:36:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd5501a3-67a5-5eb0-a85a-2c82d3a3068f with identifier: TT55225
2026-03-29 10:36:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd5501a3-67a5-5eb0-a85a-2c82d3a3068f with identifier: TT55225 to the API
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TT55225>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:13:04Z',
 'fuel_type': 'diesel',
 'id': 'fd5501a3-67a5-5eb0-a85a-2c82d3a3068f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT55225',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 124506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgcb/d1/cbd157d14b2060c41da25b1123652ac9/pa/TT55225_972d77027ee3b6758210da8b58c3aa3d.jpg',
                'https://img-pa.auto1.com/imgcb/d1/cbd157d14b2060c41da25b1123652ac9/pa/TT55225_190bbff15d888e10cd2e9e935e0f741a.jpg',
                'https://img-pa.auto1.com/imgcb/d1/cbd157d14b2060c41da25b1123652ac9/pa/TT55225_95dde21d3ebbcad107622294a5d8d69b.jpg',
                'https://img-pa.auto1.com/imgcb/d1/cbd157d14b2060c41da25b1123652ac9/pa/TT55225_b31cac88e48e299788423c1b167356ee.jpg',
                'https://img-pa.auto1.com/imgcb/d1/cbd157d14b2060c41da25b1123652ac9/pa/TT55225_eb5c2b4080c58dd0fb7737ac29e8702e.jpg',
                'https://img-pa.auto1.com/imgcb/d1/cbd157d14b2060c41da25b1123652ac9/pa/TT55225_a2f54d67e18ce8188fc14296a95d5e88.jpg',
                'https://img-pa.auto1.com/imgcb/d1/cbd157d14b2060c41da25b1123652ac9/pa/TT55225_dde01cd63156f2598c51e518dd3d6d8f.jpg',
                'https://img-pa.auto1.com/imgcb/d1/cbd157d14b2060c41da25b1123652ac9/pa/TT55225_31a8a73f7509eb7be3e3825c67602073.jpg',
                'https://img-pa.auto1.com/imgcb/d1/cbd157d14b2060c41da25b1123652ac9/pa/TT55225_02c2527c2daf685e84d9d6d93e9fa58a.jpg',
                'https://img-pa.auto1.com/imgcb/d1/cbd157d14b2060c41da25b1123652ac9/pa/TT55225_af4e8f4a5522dd42637e8e49737feedb.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd5501a3-67a5-5eb0-a85a-2c82d3a3068f/fd5501a3-67a5-5eb0-a85a-2c82d3a3068f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/d1/cbd157d14b2060c41da25b1123652ac9/pa/TT55225_972d77027ee3b6758210da8b58c3aa3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd5501a3-67a5-5eb0-a85a-2c82d3a3068f/fd5501a3-67a5-5eb0-a85a-2c82d3a3068f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/d1/cbd157d14b2060c41da25b1123652ac9/pa/TT55225_190bbff15d888e10cd2e9e935e0f741a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd5501a3-67a5-5eb0-a85a-2c82d3a3068f/fd5501a3-67a5-5eb0-a85a-2c82d3a3068f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/d1/cbd157d14b2060c41da25b1123652ac9/pa/TT55225_95dde21d3ebbcad107622294a5d8d69b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd5501a3-67a5-5eb0-a85a-2c82d3a3068f/fd5501a3-67a5-5eb0-a85a-2c82d3a3068f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/d1/cbd157d14b2060c41da25b1123652ac9/pa/TT55225_b31cac88e48e299788423c1b167356ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd5501a3-67a5-5eb0-a85a-2c82d3a3068f/fd5501a3-67a5-5eb0-a85a-2c82d3a3068f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/d1/cbd157d14b2060c41da25b1123652ac9/pa/TT55225_eb5c2b4080c58dd0fb7737ac29e8702e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd5501a3-67a5-5eb0-a85a-2c82d3a3068f/fd5501a3-67a5-5eb0-a85a-2c82d3a3068f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/d1/cbd157d14b2060c41da25b1123652ac9/pa/TT55225_a2f54d67e18ce8188fc14296a95d5e88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd5501a3-67a5-5eb0-a85a-2c82d3a3068f/fd5501a3-67a5-5eb0-a85a-2c82d3a3068f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/d1/cbd157d14b2060c41da25b1123652ac9/pa/TT55225_dde01cd63156f2598c51e518dd3d6d8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd5501a3-67a5-5eb0-a85a-2c82d3a3068f/fd5501a3-67a5-5eb0-a85a-2c82d3a3068f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 136911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/d1/cbd157d14b2060c41da25b1123652ac9/pa/TT55225_31a8a73f7509eb7be3e3825c67602073.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd5501a3-67a5-5eb0-a85a-2c82d3a3068f/fd5501a3-67a5-5eb0-a85a-2c82d3a3068f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60224,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/d1/cbd157d14b2060c41da25b1123652ac9/pa/TT55225_02c2527c2daf685e84d9d6d93e9fa58a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd5501a3-67a5-5eb0-a85a-2c82d3a3068f/fd5501a3-67a5-5eb0-a85a-2c82d3a3068f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/d1/cbd157d14b2060c41da25b1123652ac9/pa/TT55225_af4e8f4a5522dd42637e8e49737feedb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 Pure',
 'transmission': 'automatic',
 'trim': 'Pure',
 'year': 2018}
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT55225%27 HTTP/1.1" 200 None
2026-03-29 10:36:17 [auto1.de] INFO: Saving data for TT55225: {'created_time': 1774780577.847994, 'last_price_update_time': 1774780577.848011, 'auction_closing_time': 1774883584.0}
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TT55225') HTTP/1.1" 204 0
2026-03-29 10:36:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e0d4bcb-12b2-51ad-bd2b-67047066796f with identifier: JA40486
2026-03-29 10:36:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e0d4bcb-12b2-51ad-bd2b-67047066796f with identifier: JA40486
2026-03-29 10:36:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e0d4bcb-12b2-51ad-bd2b-67047066796f with identifier: JA40486 to the API
2026-03-29 10:36:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-30T15:27:25Z',
 'fuel_type': 'petrol',
 'id': '8e0d4bcb-12b2-51ad-bd2b-67047066796f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA40486',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Grande Punto',
 'odometer': 177617,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-06',
 'seller_name': None,
 'title': 'Fiat Grande Punto 1.4 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2009}
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA40486%27 HTTP/1.1" 200 None
2026-03-29 10:36:18 [auto1.de] INFO: Saving data for JA40486: {'auction_closing_time': 1774884445.0, 'created_time': 1774550666.52101, 'last_price_update_time': 1774780578.862006}
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JA40486') HTTP/1.1" 204 0
2026-03-29 10:36:18 [auto1.de] INFO: Found listing with ID: LG72403
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG72403%27 HTTP/1.1" 200 None
2026-03-29 10:36:18 [auto1.de] INFO: Scrape type for LG72403: 2
2026-03-29 10:36:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ebbff89-45aa-59b2-a188-c67ab80426dc with identifier: LG72403
2026-03-29 10:36:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ebbff89-45aa-59b2-a188-c67ab80426dc with scrape type 2
2026-03-29 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ebbff89-45aa-59b2-a188-c67ab80426dc with scrape type 2
2026-03-29 10:36:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3ebbff89-45aa-59b2-a188-c67ab80426dc, identifier: LG72403
2026-03-29 10:36:19 [auto1.de] INFO: Found listing with ID: JY67859
2026-03-29 10:36:19 [auto1.de] INFO: Found listing with ID: MG41395
2026-03-29 10:36:19 [auto1.de] INFO: Found listing with ID: JL52757
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL52757%27 HTTP/1.1" 200 None
2026-03-29 10:36:19 [auto1.de] INFO: Scrape type for JL52757: 2
2026-03-29 10:36:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b074fabb-c123-55c7-895b-bd5e7b12f194 with identifier: JL52757
2026-03-29 10:36:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b074fabb-c123-55c7-895b-bd5e7b12f194 with scrape type 2
2026-03-29 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b074fabb-c123-55c7-895b-bd5e7b12f194 with scrape type 2
2026-03-29 10:36:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b074fabb-c123-55c7-895b-bd5e7b12f194, identifier: JL52757
2026-03-29 10:36:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3ebbff89-45aa-59b2-a188-c67ab80426dc with identifier: LG72403
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-29 10:36:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 10:36:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3ebbff89-45aa-59b2-a188-c67ab80426dc with identifier: LG72403
2026-03-29 10:36:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3ebbff89-45aa-59b2-a188-c67ab80426dc with identifier: LG72403 to the API
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:32:59Z',
 'fuel_type': 'diesel',
 'id': '3ebbff89-45aa-59b2-a188-c67ab80426dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG72403',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Scudo',
 'odometer': 178344,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-21',
 'seller_name': None,
 'title': 'Fiat Scudo 2.0 JTDM Panorama Executive L2H1 165 Multijet',
 'transmission': 'manual',
 'trim': 'Panorama Executive L2H1 165 Multijet',
 'year': 2011}
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG72403%27 HTTP/1.1" 200 None
2026-03-29 10:36:19 [auto1.de] INFO: Saving data for LG72403: {'auction_closing_time': 1774884779.0, 'created_time': 1773557179.921375, 'last_price_update_time': 1774780579.552211}
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG72403') HTTP/1.1" 204 0
2026-03-29 10:36:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c75c7759-bc23-51a4-a5dd-c80ee6d5b09b with identifier: JY14465
2026-03-29 10:36:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c75c7759-bc23-51a4-a5dd-c80ee6d5b09b with scrape type 1
2026-03-29 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c75c7759-bc23-51a4-a5dd-c80ee6d5b09b
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F4e%252F104e32cb024a6063fc0ded6de82c72d8%252Fpa%252FJY14465_5ee238174b9bd8750adc18bb07dfe29d.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/4e/104e32cb024a6063fc0ded6de82c72d8/pa/JY14465_5ee238174b9bd8750adc18bb07dfe29d.jpg already downloaded
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F4e%252F104e32cb024a6063fc0ded6de82c72d8%252Fpa%252FJY14465_d7aa6441961d63f075aad9726ce56b71.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/4e/104e32cb024a6063fc0ded6de82c72d8/pa/JY14465_d7aa6441961d63f075aad9726ce56b71.jpg already downloaded
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F4e%252F104e32cb024a6063fc0ded6de82c72d8%252Fpa%252FJY14465_c5d491f656a9786a35808bb8ed9f0d6c.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/4e/104e32cb024a6063fc0ded6de82c72d8/pa/JY14465_c5d491f656a9786a35808bb8ed9f0d6c.jpg already downloaded
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F4e%252F104e32cb024a6063fc0ded6de82c72d8%252Fpa%252FJY14465_5a54fd30efd91007c53834907e0e8555.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/4e/104e32cb024a6063fc0ded6de82c72d8/pa/JY14465_5a54fd30efd91007c53834907e0e8555.jpg already downloaded
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F4e%252F104e32cb024a6063fc0ded6de82c72d8%252Fpa%252FJY14465_62fc7b64d0ce6f163dc06cd7b2138f5f.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/4e/104e32cb024a6063fc0ded6de82c72d8/pa/JY14465_62fc7b64d0ce6f163dc06cd7b2138f5f.jpg already downloaded
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F4e%252F104e32cb024a6063fc0ded6de82c72d8%252Fpa%252FJY14465_a77e1e75b61d48915a1104db12f0aed8.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/4e/104e32cb024a6063fc0ded6de82c72d8/pa/JY14465_a77e1e75b61d48915a1104db12f0aed8.jpg already downloaded
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F4e%252F104e32cb024a6063fc0ded6de82c72d8%252Fpa%252FJY14465_b749d46b43889d0f8e2f68762ea87cbc.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/4e/104e32cb024a6063fc0ded6de82c72d8/pa/JY14465_b749d46b43889d0f8e2f68762ea87cbc.jpg already downloaded
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F4e%252F104e32cb024a6063fc0ded6de82c72d8%252Fpa%252FJY14465_5874333c76f980b5773113858a99d98f.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/4e/104e32cb024a6063fc0ded6de82c72d8/pa/JY14465_5874333c76f980b5773113858a99d98f.jpg already downloaded
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F4e%252F104e32cb024a6063fc0ded6de82c72d8%252Fpa%252FJY14465_52e3673aa01cbfcd252c15471c425932.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/4e/104e32cb024a6063fc0ded6de82c72d8/pa/JY14465_52e3673aa01cbfcd252c15471c425932.jpg already downloaded
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F4e%252F104e32cb024a6063fc0ded6de82c72d8%252Fpa%252FJY14465_8953a54ce85b146877b3c8e198b0586a.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/4e/104e32cb024a6063fc0ded6de82c72d8/pa/JY14465_8953a54ce85b146877b3c8e198b0586a.jpg already downloaded
2026-03-29 10:36:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c75c7759-bc23-51a4-a5dd-c80ee6d5b09b, identifier: JY14465
2026-03-29 10:36:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b074fabb-c123-55c7-895b-bd5e7b12f194 with identifier: JL52757
2026-03-29 10:36:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b074fabb-c123-55c7-895b-bd5e7b12f194 with identifier: JL52757
2026-03-29 10:36:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b074fabb-c123-55c7-895b-bd5e7b12f194 with identifier: JL52757 to the API
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-30T15:38:05Z',
 'fuel_type': 'petrol',
 'id': 'b074fabb-c123-55c7-895b-bd5e7b12f194',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL52757',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '406',
 'odometer': 138347,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-03-30',
 'seller_name': None,
 'title': 'Peugeot 406 2.0',
 'transmission': 'manual',
 'trim': '',
 'year': 1998}
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL52757%27 HTTP/1.1" 200 None
2026-03-29 10:36:20 [auto1.de] INFO: Saving data for JL52757: {'auction_closing_time': 1774885085.0, 'created_time': 1773917109.312762, 'last_price_update_time': 1774780580.272843}
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL52757') HTTP/1.1" 204 0
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: KX92622
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX92622%27 HTTP/1.1" 200 None
2026-03-29 10:36:20 [auto1.de] INFO: Scrape type for KX92622: 2
2026-03-29 10:36:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c53de3f-879e-5a59-b906-8373c29f0c16 with identifier: KX92622
2026-03-29 10:36:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c53de3f-879e-5a59-b906-8373c29f0c16 with scrape type 2
2026-03-29 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c53de3f-879e-5a59-b906-8373c29f0c16 with scrape type 2
2026-03-29 10:36:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3c53de3f-879e-5a59-b906-8373c29f0c16, identifier: KX92622
2026-03-29 10:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BS63746> (referer: https://www.auto1.com/v1/car-details-view/BS63746/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c75c7759-bc23-51a4-a5dd-c80ee6d5b09b with identifier: JY14465
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-29 10:36:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 10:36:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c75c7759-bc23-51a4-a5dd-c80ee6d5b09b with identifier: JY14465
2026-03-29 10:36:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c75c7759-bc23-51a4-a5dd-c80ee6d5b09b with identifier: JY14465 to the API
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JY14465>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 213,
 'expiration_date': '2026-03-30T15:15:27Z',
 'fuel_type': 'hybrid',
 'id': 'c75c7759-bc23-51a4-a5dd-c80ee6d5b09b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY14465',
 'listing': 'auction',
 'location': 'DE, Atting',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 61198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img10/4e/104e32cb024a6063fc0ded6de82c72d8/pa/JY14465_5ee238174b9bd8750adc18bb07dfe29d.jpg',
                'https://img-pa.auto1.com/img10/4e/104e32cb024a6063fc0ded6de82c72d8/pa/JY14465_d7aa6441961d63f075aad9726ce56b71.jpg',
                'https://img-pa.auto1.com/img10/4e/104e32cb024a6063fc0ded6de82c72d8/pa/JY14465_c5d491f656a9786a35808bb8ed9f0d6c.jpg',
                'https://img-pa.auto1.com/img10/4e/104e32cb024a6063fc0ded6de82c72d8/pa/JY14465_5a54fd30efd91007c53834907e0e8555.jpg',
                'https://img-pa.auto1.com/img10/4e/104e32cb024a6063fc0ded6de82c72d8/pa/JY14465_62fc7b64d0ce6f163dc06cd7b2138f5f.jpg',
                'https://img-pa.auto1.com/img10/4e/104e32cb024a6063fc0ded6de82c72d8/pa/JY14465_a77e1e75b61d48915a1104db12f0aed8.jpg',
                'https://img-pa.auto1.com/img10/4e/104e32cb024a6063fc0ded6de82c72d8/pa/JY14465_b749d46b43889d0f8e2f68762ea87cbc.jpg',
                'https://img-pa.auto1.com/img10/4e/104e32cb024a6063fc0ded6de82c72d8/pa/JY14465_5874333c76f980b5773113858a99d98f.jpg',
                'https://img-pa.auto1.com/img10/4e/104e32cb024a6063fc0ded6de82c72d8/pa/JY14465_52e3673aa01cbfcd252c15471c425932.jpg',
                'https://img-pa.auto1.com/img10/4e/104e32cb024a6063fc0ded6de82c72d8/pa/JY14465_8953a54ce85b146877b3c8e198b0586a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c75c7759-bc23-51a4-a5dd-c80ee6d5b09b/c75c7759-bc23-51a4-a5dd-c80ee6d5b09b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/4e/104e32cb024a6063fc0ded6de82c72d8/pa/JY14465_5ee238174b9bd8750adc18bb07dfe29d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c75c7759-bc23-51a4-a5dd-c80ee6d5b09b/c75c7759-bc23-51a4-a5dd-c80ee6d5b09b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/4e/104e32cb024a6063fc0ded6de82c72d8/pa/JY14465_d7aa6441961d63f075aad9726ce56b71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c75c7759-bc23-51a4-a5dd-c80ee6d5b09b/c75c7759-bc23-51a4-a5dd-c80ee6d5b09b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66268,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/4e/104e32cb024a6063fc0ded6de82c72d8/pa/JY14465_c5d491f656a9786a35808bb8ed9f0d6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c75c7759-bc23-51a4-a5dd-c80ee6d5b09b/c75c7759-bc23-51a4-a5dd-c80ee6d5b09b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/4e/104e32cb024a6063fc0ded6de82c72d8/pa/JY14465_5a54fd30efd91007c53834907e0e8555.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c75c7759-bc23-51a4-a5dd-c80ee6d5b09b/c75c7759-bc23-51a4-a5dd-c80ee6d5b09b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/4e/104e32cb024a6063fc0ded6de82c72d8/pa/JY14465_62fc7b64d0ce6f163dc06cd7b2138f5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c75c7759-bc23-51a4-a5dd-c80ee6d5b09b/c75c7759-bc23-51a4-a5dd-c80ee6d5b09b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/4e/104e32cb024a6063fc0ded6de82c72d8/pa/JY14465_a77e1e75b61d48915a1104db12f0aed8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c75c7759-bc23-51a4-a5dd-c80ee6d5b09b/c75c7759-bc23-51a4-a5dd-c80ee6d5b09b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/4e/104e32cb024a6063fc0ded6de82c72d8/pa/JY14465_b749d46b43889d0f8e2f68762ea87cbc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c75c7759-bc23-51a4-a5dd-c80ee6d5b09b/c75c7759-bc23-51a4-a5dd-c80ee6d5b09b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73914,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/4e/104e32cb024a6063fc0ded6de82c72d8/pa/JY14465_5874333c76f980b5773113858a99d98f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c75c7759-bc23-51a4-a5dd-c80ee6d5b09b/c75c7759-bc23-51a4-a5dd-c80ee6d5b09b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/4e/104e32cb024a6063fc0ded6de82c72d8/pa/JY14465_52e3673aa01cbfcd252c15471c425932.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c75c7759-bc23-51a4-a5dd-c80ee6d5b09b/c75c7759-bc23-51a4-a5dd-c80ee6d5b09b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/4e/104e32cb024a6063fc0ded6de82c72d8/pa/JY14465_8953a54ce85b146877b3c8e198b0586a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan X-Trail 1.5 VC-T e-POWER Tekna+ 4x4',
 'transmission': 'automatic',
 'trim': 'Tekna+ 4x4',
 'year': 2023}
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY14465%27 HTTP/1.1" 200 None
2026-03-29 10:36:20 [auto1.de] INFO: Saving data for JY14465: {'created_time': 1774780580.93976, 'last_price_update_time': 1774780580.939773, 'auction_closing_time': 1774883727.0}
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY14465') HTTP/1.1" 204 0
2026-03-29 10:36:20 [auto1.de] INFO: Found listing with ID: SG28932
2026-03-29 10:36:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3c53de3f-879e-5a59-b906-8373c29f0c16 with identifier: KX92622
2026-03-29 10:36:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3c53de3f-879e-5a59-b906-8373c29f0c16 with identifier: KX92622
2026-03-29 10:36:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3c53de3f-879e-5a59-b906-8373c29f0c16 with identifier: KX92622 to the API
2026-03-29 10:36:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:18:53Z',
 'fuel_type': 'petrol',
 'id': '3c53de3f-879e-5a59-b906-8373c29f0c16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX92622',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Galaxy',
 'odometer': 78385,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-28',
 'seller_name': None,
 'title': 'Ford Galaxy 1.5 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2018}
2026-03-29 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX92622%27 HTTP/1.1" 200 None
2026-03-29 10:36:21 [auto1.de] INFO: Saving data for KX92622: {'auction_closing_time': 1774883933.0, 'created_time': 1774550734.616378, 'last_price_update_time': 1774780581.377228}
2026-03-29 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX92622') HTTP/1.1" 204 0
2026-03-29 10:36:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:21 [auto1.de] INFO: Found listing with ID: KY89472
2026-03-29 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY89472%27 HTTP/1.1" 200 None
2026-03-29 10:36:21 [auto1.de] INFO: Scrape type for KY89472: 2
2026-03-29 10:36:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c40c78c9-93c2-53d1-949a-fee233885e5f with identifier: KY89472
2026-03-29 10:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c40c78c9-93c2-53d1-949a-fee233885e5f with scrape type 2
2026-03-29 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c40c78c9-93c2-53d1-949a-fee233885e5f with scrape type 2
2026-03-29 10:36:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c40c78c9-93c2-53d1-949a-fee233885e5f, identifier: KY89472
2026-03-29 10:36:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c40c78c9-93c2-53d1-949a-fee233885e5f with identifier: KY89472
2026-03-29 10:36:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c40c78c9-93c2-53d1-949a-fee233885e5f with identifier: KY89472
2026-03-29 10:36:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c40c78c9-93c2-53d1-949a-fee233885e5f with identifier: KY89472 to the API
2026-03-29 10:36:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:19:05Z',
 'fuel_type': 'petrol',
 'id': 'c40c78c9-93c2-53d1-949a-fee233885e5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY89472',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 140992,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-26',
 'seller_name': None,
 'title': 'Audi A3 Sportback 30 TFSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-29 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY89472%27 HTTP/1.1" 200 None
2026-03-29 10:36:21 [auto1.de] INFO: Saving data for KY89472: {'auction_closing_time': 1774883945.0, 'created_time': 1774552330.520192, 'last_price_update_time': 1774780581.895595}
2026-03-29 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY89472') HTTP/1.1" 204 0
2026-03-29 10:36:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91a835ae-9bc4-56b9-a3ea-0daa0f2085e1 with identifier: BS63746
2026-03-29 10:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91a835ae-9bc4-56b9-a3ea-0daa0f2085e1 with scrape type 1
2026-03-29 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 91a835ae-9bc4-56b9-a3ea-0daa0f2085e1
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Faf%252F41afed1bd70f06459a54ca4dced2c28c%252Fpa%252FBS63746_b60d2bf413fc3766c20de15e1a68edcd.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/af/41afed1bd70f06459a54ca4dced2c28c/pa/BS63746_b60d2bf413fc3766c20de15e1a68edcd.jpg already downloaded
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Faf%252F41afed1bd70f06459a54ca4dced2c28c%252Fpa%252FBS63746_d4245431136e7461f58be4621291fff7.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/af/41afed1bd70f06459a54ca4dced2c28c/pa/BS63746_d4245431136e7461f58be4621291fff7.jpg already downloaded
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Faf%252F41afed1bd70f06459a54ca4dced2c28c%252Fpa%252FBS63746_2e2d8ead98c31bb8dcff576589a52176.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/af/41afed1bd70f06459a54ca4dced2c28c/pa/BS63746_2e2d8ead98c31bb8dcff576589a52176.jpg already downloaded
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Faf%252F41afed1bd70f06459a54ca4dced2c28c%252Fpa%252FBS63746_f55fd0e2d876ceaed84f5b6464b95c79.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/af/41afed1bd70f06459a54ca4dced2c28c/pa/BS63746_f55fd0e2d876ceaed84f5b6464b95c79.jpg already downloaded
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Faf%252F41afed1bd70f06459a54ca4dced2c28c%252Fpa%252FBS63746_904927691d2e82c1f5523d66b1fafeb5.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/af/41afed1bd70f06459a54ca4dced2c28c/pa/BS63746_904927691d2e82c1f5523d66b1fafeb5.jpg already downloaded
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Faf%252F41afed1bd70f06459a54ca4dced2c28c%252Fpa%252FBS63746_765dd50aabf11962f5b1ae4e882e5cb8.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/af/41afed1bd70f06459a54ca4dced2c28c/pa/BS63746_765dd50aabf11962f5b1ae4e882e5cb8.jpg already downloaded
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Faf%252F41afed1bd70f06459a54ca4dced2c28c%252Fpa%252FBS63746_951f0186d7bb5322ec5110939cb0a832.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/af/41afed1bd70f06459a54ca4dced2c28c/pa/BS63746_951f0186d7bb5322ec5110939cb0a832.jpg already downloaded
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Faf%252F41afed1bd70f06459a54ca4dced2c28c%252Fpa%252FBS63746_1d961f3b471beb5066c6576c8b72f645.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/af/41afed1bd70f06459a54ca4dced2c28c/pa/BS63746_1d961f3b471beb5066c6576c8b72f645.jpg already downloaded
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Faf%252F41afed1bd70f06459a54ca4dced2c28c%252Fpa%252FBS63746_762eee9c6ba2d6bddcb884bc6c065ea5.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/af/41afed1bd70f06459a54ca4dced2c28c/pa/BS63746_762eee9c6ba2d6bddcb884bc6c065ea5.jpg already downloaded
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252Faf%252F41afed1bd70f06459a54ca4dced2c28c%252Fpa%252FBS63746_88f8e4b2bf44ecdebbe3011aa6a37e39.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/af/41afed1bd70f06459a54ca4dced2c28c/pa/BS63746_88f8e4b2bf44ecdebbe3011aa6a37e39.jpg already downloaded
2026-03-29 10:36:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 91a835ae-9bc4-56b9-a3ea-0daa0f2085e1, identifier: BS63746
2026-03-29 10:36:22 [auto1.de] INFO: Found listing with ID: WM17924
2026-03-29 10:36:22 [auto1.de] INFO: Found listing with ID: SV54413
2026-03-29 10:36:22 [auto1.de] INFO: Found listing with ID: CL13866
2026-03-29 10:36:22 [auto1.de] INFO: Found listing with ID: KP55119
2026-03-29 10:36:22 [auto1.de] INFO: Found listing with ID: BY81957
2026-03-29 10:36:22 [auto1.de] INFO: Found listing with ID: NJ51378
2026-03-29 10:36:22 [auto1.de] INFO: Found listing with ID: CF02627
2026-03-29 10:36:22 [auto1.de] INFO: Found listing with ID: DM11182
2026-03-29 10:36:22 [auto1.de] INFO: Found listing with ID: NV13979
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV13979%27 HTTP/1.1" 200 None
2026-03-29 10:36:22 [auto1.de] INFO: Scrape type for NV13979: 2
2026-03-29 10:36:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd4b47c4-d66e-5f74-96aa-7787461cb229 with identifier: NV13979
2026-03-29 10:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd4b47c4-d66e-5f74-96aa-7787461cb229 with scrape type 2
2026-03-29 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd4b47c4-d66e-5f74-96aa-7787461cb229 with scrape type 2
2026-03-29 10:36:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd4b47c4-d66e-5f74-96aa-7787461cb229, identifier: NV13979
2026-03-29 10:36:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 91a835ae-9bc4-56b9-a3ea-0daa0f2085e1 with identifier: BS63746
2026-03-29 10:36:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 91a835ae-9bc4-56b9-a3ea-0daa0f2085e1 with identifier: BS63746
2026-03-29 10:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 91a835ae-9bc4-56b9-a3ea-0daa0f2085e1 with identifier: BS63746 to the API
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BS63746>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:48:02Z',
 'fuel_type': 'petrol',
 'id': '91a835ae-9bc4-56b9-a3ea-0daa0f2085e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS63746',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 63827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img41/af/41afed1bd70f06459a54ca4dced2c28c/pa/BS63746_b60d2bf413fc3766c20de15e1a68edcd.jpg',
                'https://img-pa.auto1.com/img41/af/41afed1bd70f06459a54ca4dced2c28c/pa/BS63746_d4245431136e7461f58be4621291fff7.jpg',
                'https://img-pa.auto1.com/img41/af/41afed1bd70f06459a54ca4dced2c28c/pa/BS63746_2e2d8ead98c31bb8dcff576589a52176.jpg',
                'https://img-pa.auto1.com/img41/af/41afed1bd70f06459a54ca4dced2c28c/pa/BS63746_f55fd0e2d876ceaed84f5b6464b95c79.jpg',
                'https://img-pa.auto1.com/img41/af/41afed1bd70f06459a54ca4dced2c28c/pa/BS63746_904927691d2e82c1f5523d66b1fafeb5.jpg',
                'https://img-pa.auto1.com/img41/af/41afed1bd70f06459a54ca4dced2c28c/pa/BS63746_765dd50aabf11962f5b1ae4e882e5cb8.jpg',
                'https://img-pa.auto1.com/img41/af/41afed1bd70f06459a54ca4dced2c28c/pa/BS63746_951f0186d7bb5322ec5110939cb0a832.jpg',
                'https://img-pa.auto1.com/img41/af/41afed1bd70f06459a54ca4dced2c28c/pa/BS63746_1d961f3b471beb5066c6576c8b72f645.jpg',
                'https://img-pa.auto1.com/img41/af/41afed1bd70f06459a54ca4dced2c28c/pa/BS63746_762eee9c6ba2d6bddcb884bc6c065ea5.jpg',
                'https://img-pa.auto1.com/img41/af/41afed1bd70f06459a54ca4dced2c28c/pa/BS63746_88f8e4b2bf44ecdebbe3011aa6a37e39.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91a835ae-9bc4-56b9-a3ea-0daa0f2085e1/91a835ae-9bc4-56b9-a3ea-0daa0f2085e1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/af/41afed1bd70f06459a54ca4dced2c28c/pa/BS63746_b60d2bf413fc3766c20de15e1a68edcd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91a835ae-9bc4-56b9-a3ea-0daa0f2085e1/91a835ae-9bc4-56b9-a3ea-0daa0f2085e1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/af/41afed1bd70f06459a54ca4dced2c28c/pa/BS63746_d4245431136e7461f58be4621291fff7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91a835ae-9bc4-56b9-a3ea-0daa0f2085e1/91a835ae-9bc4-56b9-a3ea-0daa0f2085e1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/af/41afed1bd70f06459a54ca4dced2c28c/pa/BS63746_2e2d8ead98c31bb8dcff576589a52176.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91a835ae-9bc4-56b9-a3ea-0daa0f2085e1/91a835ae-9bc4-56b9-a3ea-0daa0f2085e1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/af/41afed1bd70f06459a54ca4dced2c28c/pa/BS63746_f55fd0e2d876ceaed84f5b6464b95c79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91a835ae-9bc4-56b9-a3ea-0daa0f2085e1/91a835ae-9bc4-56b9-a3ea-0daa0f2085e1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/af/41afed1bd70f06459a54ca4dced2c28c/pa/BS63746_904927691d2e82c1f5523d66b1fafeb5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91a835ae-9bc4-56b9-a3ea-0daa0f2085e1/91a835ae-9bc4-56b9-a3ea-0daa0f2085e1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/af/41afed1bd70f06459a54ca4dced2c28c/pa/BS63746_765dd50aabf11962f5b1ae4e882e5cb8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91a835ae-9bc4-56b9-a3ea-0daa0f2085e1/91a835ae-9bc4-56b9-a3ea-0daa0f2085e1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/af/41afed1bd70f06459a54ca4dced2c28c/pa/BS63746_951f0186d7bb5322ec5110939cb0a832.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91a835ae-9bc4-56b9-a3ea-0daa0f2085e1/91a835ae-9bc4-56b9-a3ea-0daa0f2085e1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/af/41afed1bd70f06459a54ca4dced2c28c/pa/BS63746_1d961f3b471beb5066c6576c8b72f645.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91a835ae-9bc4-56b9-a3ea-0daa0f2085e1/91a835ae-9bc4-56b9-a3ea-0daa0f2085e1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/af/41afed1bd70f06459a54ca4dced2c28c/pa/BS63746_762eee9c6ba2d6bddcb884bc6c065ea5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91a835ae-9bc4-56b9-a3ea-0daa0f2085e1/91a835ae-9bc4-56b9-a3ea-0daa0f2085e1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33779,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/af/41afed1bd70f06459a54ca4dced2c28c/pa/BS63746_88f8e4b2bf44ecdebbe3011aa6a37e39.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.0 TSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2021}
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS63746%27 HTTP/1.1" 200 None
2026-03-29 10:36:23 [auto1.de] INFO: Saving data for BS63746: {'created_time': 1774780583.035773, 'last_price_update_time': 1774780583.035782, 'auction_closing_time': 1774885682.0}
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS63746') HTTP/1.1" 204 0
2026-03-29 10:36:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd4b47c4-d66e-5f74-96aa-7787461cb229 with identifier: NV13979
2026-03-29 10:36:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd4b47c4-d66e-5f74-96aa-7787461cb229 with identifier: NV13979
2026-03-29 10:36:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd4b47c4-d66e-5f74-96aa-7787461cb229 with identifier: NV13979 to the API
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:27:48Z',
 'fuel_type': 'petrol',
 'id': 'cd4b47c4-d66e-5f74-96aa-7787461cb229',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV13979',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 108118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-25',
 'seller_name': None,
 'title': 'Opel Astra 1.2 Turbo Opel 2020 Start/Stop',
 'transmission': 'manual',
 'trim': '2020 Start/Stop',
 'year': 2020}
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV13979%27 HTTP/1.1" 200 None
2026-03-29 10:36:23 [auto1.de] INFO: Saving data for NV13979: {'auction_closing_time': 1774884468.0, 'created_time': 1774002464.311014, 'last_price_update_time': 1774780583.43841}
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV13979') HTTP/1.1" 204 0
2026-03-29 10:36:23 [auto1.de] INFO: Found listing with ID: SR10535
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR10535%27 HTTP/1.1" 200 None
2026-03-29 10:36:23 [auto1.de] INFO: Scrape type for SR10535: 2
2026-03-29 10:36:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bcb943c-244d-5868-ab3d-b1618e2d7fac with identifier: SR10535
2026-03-29 10:36:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bcb943c-244d-5868-ab3d-b1618e2d7fac with scrape type 2
2026-03-29 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bcb943c-244d-5868-ab3d-b1618e2d7fac with scrape type 2
2026-03-29 10:36:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7bcb943c-244d-5868-ab3d-b1618e2d7fac, identifier: SR10535
2026-03-29 10:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HB92022/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7bcb943c-244d-5868-ab3d-b1618e2d7fac with identifier: SR10535
2026-03-29 10:36:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7bcb943c-244d-5868-ab3d-b1618e2d7fac with identifier: SR10535
2026-03-29 10:36:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7bcb943c-244d-5868-ab3d-b1618e2d7fac with identifier: SR10535 to the API
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:48:08Z',
 'fuel_type': 'petrol',
 'id': '7bcb943c-244d-5868-ab3d-b1618e2d7fac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR10535',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 304472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-31',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2008}
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR10535%27 HTTP/1.1" 200 None
2026-03-29 10:36:23 [auto1.de] INFO: Saving data for SR10535: {'auction_closing_time': 1774885688.0, 'created_time': 1774550677.46395, 'last_price_update_time': 1774780583.897095}
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR10535') HTTP/1.1" 204 0
2026-03-29 10:36:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HB21625> (referer: https://www.auto1.com/v1/car-details-view/HB21625/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:23 [auto1.de] INFO: Found listing with ID: EX39495
2026-03-29 10:36:23 [auto1.de] INFO: Found listing with ID: LY60106
2026-03-29 10:36:23 [auto1.de] INFO: Found listing with ID: GR07934
2026-03-29 10:36:23 [auto1.de] INFO: Found listing with ID: GZ84157
2026-03-29 10:36:23 [auto1.de] INFO: Found listing with ID: CM86164
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM86164%27 HTTP/1.1" 200 None
2026-03-29 10:36:23 [auto1.de] INFO: Scrape type for CM86164: 2
2026-03-29 10:36:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 790041eb-c3bd-54f1-8fbf-02055ac2c84f with identifier: CM86164
2026-03-29 10:36:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 790041eb-c3bd-54f1-8fbf-02055ac2c84f with scrape type 2
2026-03-29 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 790041eb-c3bd-54f1-8fbf-02055ac2c84f with scrape type 2
2026-03-29 10:36:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 790041eb-c3bd-54f1-8fbf-02055ac2c84f, identifier: CM86164
2026-03-29 10:36:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 790041eb-c3bd-54f1-8fbf-02055ac2c84f with identifier: CM86164
2026-03-29 10:36:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 790041eb-c3bd-54f1-8fbf-02055ac2c84f with identifier: CM86164
2026-03-29 10:36:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 790041eb-c3bd-54f1-8fbf-02055ac2c84f with identifier: CM86164 to the API
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:36:00Z',
 'fuel_type': 'petrol',
 'id': '790041eb-c3bd-54f1-8fbf-02055ac2c84f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM86164',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Colt',
 'odometer': 85249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-27',
 'seller_name': None,
 'title': 'Mitsubishi Colt 1.3 Motion Plus',
 'transmission': 'manual',
 'trim': 'Motion Plus',
 'year': 2008}
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM86164%27 HTTP/1.1" 200 None
2026-03-29 10:36:24 [auto1.de] INFO: Saving data for CM86164: {'auction_closing_time': 1774884960.0, 'created_time': 1774550681.882259, 'last_price_update_time': 1774780584.371078}
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM86164') HTTP/1.1" 204 0
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: UF75132
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: FR75533
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: AD16750
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD16750%27 HTTP/1.1" 200 None
2026-03-29 10:36:24 [auto1.de] INFO: Scrape type for AD16750: 2
2026-03-29 10:36:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5635860-f6ad-5589-b8b2-01c1ee53888a with identifier: AD16750
2026-03-29 10:36:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5635860-f6ad-5589-b8b2-01c1ee53888a with scrape type 2
2026-03-29 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5635860-f6ad-5589-b8b2-01c1ee53888a with scrape type 2
2026-03-29 10:36:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5635860-f6ad-5589-b8b2-01c1ee53888a, identifier: AD16750
2026-03-29 10:36:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5635860-f6ad-5589-b8b2-01c1ee53888a with identifier: AD16750
2026-03-29 10:36:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5635860-f6ad-5589-b8b2-01c1ee53888a with identifier: AD16750
2026-03-29 10:36:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5635860-f6ad-5589-b8b2-01c1ee53888a with identifier: AD16750 to the API
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:01:10Z',
 'fuel_type': 'diesel',
 'id': 'b5635860-f6ad-5589-b8b2-01c1ee53888a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD16750',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 383887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-31',
 'seller_name': None,
 'title': 'BMW X3 sDrive 18d',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD16750%27 HTTP/1.1" 200 None
2026-03-29 10:36:24 [auto1.de] INFO: Saving data for AD16750: {'auction_closing_time': 1774882870.0, 'created_time': 1773686357.624209, 'last_price_update_time': 1774780584.929505}
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD16750') HTTP/1.1" 204 0
2026-03-29 10:36:24 [auto1.de] INFO: Found listing with ID: JE79090
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE79090%27 HTTP/1.1" 200 None
2026-03-29 10:36:24 [auto1.de] INFO: Scrape type for JE79090: 2
2026-03-29 10:36:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2550410a-2927-517a-815f-ebfeaf4472d7 with identifier: JE79090
2026-03-29 10:36:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2550410a-2927-517a-815f-ebfeaf4472d7 with scrape type 2
2026-03-29 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2550410a-2927-517a-815f-ebfeaf4472d7 with scrape type 2
2026-03-29 10:36:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2550410a-2927-517a-815f-ebfeaf4472d7, identifier: JE79090
2026-03-29 10:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TE08681> (referer: https://www.auto1.com/v1/car-details-view/TE08681/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XG25622/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GA07513> (referer: https://www.auto1.com/v1/car-details-view/GA07513/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2550410a-2927-517a-815f-ebfeaf4472d7 with identifier: JE79090
2026-03-29 10:36:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2550410a-2927-517a-815f-ebfeaf4472d7 with identifier: JE79090
2026-03-29 10:36:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2550410a-2927-517a-815f-ebfeaf4472d7 with identifier: JE79090 to the API
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:05:59Z',
 'fuel_type': 'petrol',
 'id': '2550410a-2927-517a-815f-ebfeaf4472d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE79090',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 43525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-04',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.4 Impression',
 'transmission': 'manual',
 'trim': 'Impression',
 'year': 2015}
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE79090%27 HTTP/1.1" 200 None
2026-03-29 10:36:25 [auto1.de] INFO: Saving data for JE79090: {'auction_closing_time': 1774883159.0, 'created_time': 1774550958.378453, 'last_price_update_time': 1774780585.424483}
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE79090') HTTP/1.1" 204 0
2026-03-29 10:36:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 240effed-d60a-5bd0-b5ae-6e300435bb4b with identifier: HB21625
2026-03-29 10:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 240effed-d60a-5bd0-b5ae-6e300435bb4b with scrape type 1
2026-03-29 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 240effed-d60a-5bd0-b5ae-6e300435bb4b
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F74%252F2074bbd23f9be5fe0958c89463043ec0%252Fpa%252FHB21625_d076a634752dd1664a34d8021c86f9ca.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/74/2074bbd23f9be5fe0958c89463043ec0/pa/HB21625_d076a634752dd1664a34d8021c86f9ca.jpg already downloaded
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F74%252F2074bbd23f9be5fe0958c89463043ec0%252Fpa%252FHB21625_c4ab04d47aef5e976dfa49d4b95170dd.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/74/2074bbd23f9be5fe0958c89463043ec0/pa/HB21625_c4ab04d47aef5e976dfa49d4b95170dd.jpg already downloaded
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F74%252F2074bbd23f9be5fe0958c89463043ec0%252Fpa%252FHB21625_6054c800cfcc24feb7e1f09bd9a122c0.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/74/2074bbd23f9be5fe0958c89463043ec0/pa/HB21625_6054c800cfcc24feb7e1f09bd9a122c0.jpg already downloaded
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F74%252F2074bbd23f9be5fe0958c89463043ec0%252Fpa%252FHB21625_5b98a8016d77a263c8f20be6fe0f2c08.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/74/2074bbd23f9be5fe0958c89463043ec0/pa/HB21625_5b98a8016d77a263c8f20be6fe0f2c08.jpg already downloaded
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F74%252F2074bbd23f9be5fe0958c89463043ec0%252Fpa%252FHB21625_51d8577cdbcaafd29dbf1537d75b3d11.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/74/2074bbd23f9be5fe0958c89463043ec0/pa/HB21625_51d8577cdbcaafd29dbf1537d75b3d11.jpg already downloaded
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F74%252F2074bbd23f9be5fe0958c89463043ec0%252Fpa%252FHB21625_e507cd5ca18c53a908f8cf9d5c0de9e5.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/74/2074bbd23f9be5fe0958c89463043ec0/pa/HB21625_e507cd5ca18c53a908f8cf9d5c0de9e5.jpg already downloaded
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F74%252F2074bbd23f9be5fe0958c89463043ec0%252Fpa%252FHB21625_dfa1b9f1dae046c9319068a846a89cb9.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/74/2074bbd23f9be5fe0958c89463043ec0/pa/HB21625_dfa1b9f1dae046c9319068a846a89cb9.jpg already downloaded
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F74%252F2074bbd23f9be5fe0958c89463043ec0%252Fpa%252FHB21625_f38dd96ecdf44f0c9b5337676ee179c9.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/74/2074bbd23f9be5fe0958c89463043ec0/pa/HB21625_f38dd96ecdf44f0c9b5337676ee179c9.jpg already downloaded
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F74%252F2074bbd23f9be5fe0958c89463043ec0%252Fpa%252FHB21625_f4098cda30604fb9e50a1244bcf48805.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/74/2074bbd23f9be5fe0958c89463043ec0/pa/HB21625_f4098cda30604fb9e50a1244bcf48805.jpg already downloaded
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg20%252F74%252F2074bbd23f9be5fe0958c89463043ec0%252Fpa%252FHB21625_afb19c029850ee5a6d0775c6d502bc7b.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/74/2074bbd23f9be5fe0958c89463043ec0/pa/HB21625_afb19c029850ee5a6d0775c6d502bc7b.jpg already downloaded
2026-03-29 10:36:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 240effed-d60a-5bd0-b5ae-6e300435bb4b, identifier: HB21625
2026-03-29 10:36:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:25 [auto1.de] INFO: Found listing with ID: TU64777
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU64777%27 HTTP/1.1" 200 None
2026-03-29 10:36:25 [auto1.de] INFO: Scrape type for TU64777: 2
2026-03-29 10:36:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2958cc2-dc9f-540c-9e88-ab9b3db38262 with identifier: TU64777
2026-03-29 10:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2958cc2-dc9f-540c-9e88-ab9b3db38262 with scrape type 2
2026-03-29 10:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2958cc2-dc9f-540c-9e88-ab9b3db38262 with scrape type 2
2026-03-29 10:36:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2958cc2-dc9f-540c-9e88-ab9b3db38262, identifier: TU64777
2026-03-29 10:36:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 240effed-d60a-5bd0-b5ae-6e300435bb4b with identifier: HB21625
2026-03-29 10:36:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 240effed-d60a-5bd0-b5ae-6e300435bb4b with identifier: HB21625
2026-03-29 10:36:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 240effed-d60a-5bd0-b5ae-6e300435bb4b with identifier: HB21625 to the API
2026-03-29 10:36:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HB21625>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:36:29Z',
 'fuel_type': 'petrol',
 'id': '240effed-d60a-5bd0-b5ae-6e300435bb4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB21625',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 55195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img20/74/2074bbd23f9be5fe0958c89463043ec0/pa/HB21625_d076a634752dd1664a34d8021c86f9ca.jpg',
                'https://img-pa.auto1.com/img20/74/2074bbd23f9be5fe0958c89463043ec0/pa/HB21625_c4ab04d47aef5e976dfa49d4b95170dd.jpg',
                'https://img-pa.auto1.com/img20/74/2074bbd23f9be5fe0958c89463043ec0/pa/HB21625_6054c800cfcc24feb7e1f09bd9a122c0.jpg',
                'https://img-pa.auto1.com/img20/74/2074bbd23f9be5fe0958c89463043ec0/pa/HB21625_5b98a8016d77a263c8f20be6fe0f2c08.jpg',
                'https://img-pa.auto1.com/img20/74/2074bbd23f9be5fe0958c89463043ec0/pa/HB21625_51d8577cdbcaafd29dbf1537d75b3d11.jpg',
                'https://img-pa.auto1.com/img20/74/2074bbd23f9be5fe0958c89463043ec0/pa/HB21625_e507cd5ca18c53a908f8cf9d5c0de9e5.jpg',
                'https://img-pa.auto1.com/img20/74/2074bbd23f9be5fe0958c89463043ec0/pa/HB21625_dfa1b9f1dae046c9319068a846a89cb9.jpg',
                'https://img-pa.auto1.com/img20/74/2074bbd23f9be5fe0958c89463043ec0/pa/HB21625_f38dd96ecdf44f0c9b5337676ee179c9.jpg',
                'https://img-pa.auto1.com/img20/74/2074bbd23f9be5fe0958c89463043ec0/pa/HB21625_f4098cda30604fb9e50a1244bcf48805.jpg',
                'https://img-pa.auto1.com/img20/74/2074bbd23f9be5fe0958c89463043ec0/pa/HB21625_afb19c029850ee5a6d0775c6d502bc7b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_240effed-d60a-5bd0-b5ae-6e300435bb4b/240effed-d60a-5bd0-b5ae-6e300435bb4b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/74/2074bbd23f9be5fe0958c89463043ec0/pa/HB21625_d076a634752dd1664a34d8021c86f9ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_240effed-d60a-5bd0-b5ae-6e300435bb4b/240effed-d60a-5bd0-b5ae-6e300435bb4b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/74/2074bbd23f9be5fe0958c89463043ec0/pa/HB21625_c4ab04d47aef5e976dfa49d4b95170dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_240effed-d60a-5bd0-b5ae-6e300435bb4b/240effed-d60a-5bd0-b5ae-6e300435bb4b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80319,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/74/2074bbd23f9be5fe0958c89463043ec0/pa/HB21625_6054c800cfcc24feb7e1f09bd9a122c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_240effed-d60a-5bd0-b5ae-6e300435bb4b/240effed-d60a-5bd0-b5ae-6e300435bb4b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/74/2074bbd23f9be5fe0958c89463043ec0/pa/HB21625_5b98a8016d77a263c8f20be6fe0f2c08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_240effed-d60a-5bd0-b5ae-6e300435bb4b/240effed-d60a-5bd0-b5ae-6e300435bb4b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107685,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/74/2074bbd23f9be5fe0958c89463043ec0/pa/HB21625_51d8577cdbcaafd29dbf1537d75b3d11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_240effed-d60a-5bd0-b5ae-6e300435bb4b/240effed-d60a-5bd0-b5ae-6e300435bb4b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/74/2074bbd23f9be5fe0958c89463043ec0/pa/HB21625_e507cd5ca18c53a908f8cf9d5c0de9e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_240effed-d60a-5bd0-b5ae-6e300435bb4b/240effed-d60a-5bd0-b5ae-6e300435bb4b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/74/2074bbd23f9be5fe0958c89463043ec0/pa/HB21625_dfa1b9f1dae046c9319068a846a89cb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_240effed-d60a-5bd0-b5ae-6e300435bb4b/240effed-d60a-5bd0-b5ae-6e300435bb4b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/74/2074bbd23f9be5fe0958c89463043ec0/pa/HB21625_f38dd96ecdf44f0c9b5337676ee179c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_240effed-d60a-5bd0-b5ae-6e300435bb4b/240effed-d60a-5bd0-b5ae-6e300435bb4b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/74/2074bbd23f9be5fe0958c89463043ec0/pa/HB21625_f4098cda30604fb9e50a1244bcf48805.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_240effed-d60a-5bd0-b5ae-6e300435bb4b/240effed-d60a-5bd0-b5ae-6e300435bb4b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99239,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img20/74/2074bbd23f9be5fe0958c89463043ec0/pa/HB21625_afb19c029850ee5a6d0775c6d502bc7b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia XCeed 1.4 TGDI JBL Sound Edition',
 'transmission': 'automatic',
 'trim': 'JBL Sound Edition',
 'year': 2020}
2026-03-29 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB21625%27 HTTP/1.1" 200 None
2026-03-29 10:36:26 [auto1.de] INFO: Saving data for HB21625: {'created_time': 1774780586.170729, 'last_price_update_time': 1774780586.17074, 'auction_closing_time': 1774884989.0}
2026-03-29 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB21625') HTTP/1.1" 204 0
2026-03-29 10:36:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2958cc2-dc9f-540c-9e88-ab9b3db38262 with identifier: TU64777
2026-03-29 10:36:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2958cc2-dc9f-540c-9e88-ab9b3db38262 with identifier: TU64777
2026-03-29 10:36:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2958cc2-dc9f-540c-9e88-ab9b3db38262 with identifier: TU64777 to the API
2026-03-29 10:36:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:55:11Z',
 'fuel_type': 'diesel',
 'id': 'd2958cc2-dc9f-540c-9e88-ab9b3db38262',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU64777',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 135167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-12',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-29 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU64777%27 HTTP/1.1" 200 None
2026-03-29 10:36:26 [auto1.de] INFO: Saving data for TU64777: {'auction_closing_time': 1774886111.0, 'created_time': 1774379580.78464, 'last_price_update_time': 1774780586.533781}
2026-03-29 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU64777') HTTP/1.1" 204 0
2026-03-29 10:36:26 [auto1.de] INFO: Found listing with ID: RK76188
2026-03-29 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK76188%27 HTTP/1.1" 200 None
2026-03-29 10:36:26 [auto1.de] INFO: Scrape type for RK76188: 2
2026-03-29 10:36:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c4f8e85-5354-5a52-bfc3-2cb01536f0db with identifier: RK76188
2026-03-29 10:36:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c4f8e85-5354-5a52-bfc3-2cb01536f0db with scrape type 2
2026-03-29 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c4f8e85-5354-5a52-bfc3-2cb01536f0db with scrape type 2
2026-03-29 10:36:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3c4f8e85-5354-5a52-bfc3-2cb01536f0db, identifier: RK76188
2026-03-29 10:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NB51359> (referer: https://www.auto1.com/v1/car-details-view/NB51359/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3c4f8e85-5354-5a52-bfc3-2cb01536f0db with identifier: RK76188
2026-03-29 10:36:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3c4f8e85-5354-5a52-bfc3-2cb01536f0db with identifier: RK76188
2026-03-29 10:36:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3c4f8e85-5354-5a52-bfc3-2cb01536f0db with identifier: RK76188 to the API
2026-03-29 10:36:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:23:58Z',
 'fuel_type': 'diesel',
 'id': '3c4f8e85-5354-5a52-bfc3-2cb01536f0db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK76188',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 226034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-24',
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-29 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK76188%27 HTTP/1.1" 200 None
2026-03-29 10:36:26 [auto1.de] INFO: Saving data for RK76188: {'auction_closing_time': 1774884238.0, 'created_time': 1773428916.426553, 'last_price_update_time': 1774780586.969174}
2026-03-29 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RK76188') HTTP/1.1" 204 0
2026-03-29 10:36:26 [auto1.de] INFO: Channel: 24h | Page: 7 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1502214c-2353-5432-8930-45f4678b64d5 with identifier: TE08681
2026-03-29 10:36:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1502214c-2353-5432-8930-45f4678b64d5 with scrape type 1
2026-03-29 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1502214c-2353-5432-8930-45f4678b64d5
2026-03-29 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fad%252Fd4adff06d2059e4f229a2445d157f1f6%252Fpa%252FTE08681_4cf5c2bdd1ca03318f767e16b8b5b292.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ad/d4adff06d2059e4f229a2445d157f1f6/pa/TE08681_4cf5c2bdd1ca03318f767e16b8b5b292.jpg already downloaded
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fad%252Fd4adff06d2059e4f229a2445d157f1f6%252Fpa%252FTE08681_d156e2defa6e62f33e34444d7f3526ac.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ad/d4adff06d2059e4f229a2445d157f1f6/pa/TE08681_d156e2defa6e62f33e34444d7f3526ac.jpg already downloaded
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fad%252Fd4adff06d2059e4f229a2445d157f1f6%252Fpa%252FTE08681_9cb159050e08805b18994b37a1f7979f.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ad/d4adff06d2059e4f229a2445d157f1f6/pa/TE08681_9cb159050e08805b18994b37a1f7979f.jpg already downloaded
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fad%252Fd4adff06d2059e4f229a2445d157f1f6%252Fpa%252FTE08681_ad347a42822e9834359c925f259e8948.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ad/d4adff06d2059e4f229a2445d157f1f6/pa/TE08681_ad347a42822e9834359c925f259e8948.jpg already downloaded
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fad%252Fd4adff06d2059e4f229a2445d157f1f6%252Fpa%252FTE08681_f051d6dbb8f1926643c9a7cbe6d2e76b.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ad/d4adff06d2059e4f229a2445d157f1f6/pa/TE08681_f051d6dbb8f1926643c9a7cbe6d2e76b.jpg already downloaded
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fad%252Fd4adff06d2059e4f229a2445d157f1f6%252Fpa%252FTE08681_8fbea88b0ea243265fa567ce3fa52635.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ad/d4adff06d2059e4f229a2445d157f1f6/pa/TE08681_8fbea88b0ea243265fa567ce3fa52635.jpg already downloaded
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fad%252Fd4adff06d2059e4f229a2445d157f1f6%252Fpa%252FTE08681_db58376a619dd176f81ef6b737f79928.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ad/d4adff06d2059e4f229a2445d157f1f6/pa/TE08681_db58376a619dd176f81ef6b737f79928.jpg already downloaded
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fad%252Fd4adff06d2059e4f229a2445d157f1f6%252Fpa%252FTE08681_9fd3b23eb8dfc0d88691631e3bf600ca.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ad/d4adff06d2059e4f229a2445d157f1f6/pa/TE08681_9fd3b23eb8dfc0d88691631e3bf600ca.jpg already downloaded
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fad%252Fd4adff06d2059e4f229a2445d157f1f6%252Fpa%252FTE08681_bbab875ccc3b677cc87811e4d749dfe3.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ad/d4adff06d2059e4f229a2445d157f1f6/pa/TE08681_bbab875ccc3b677cc87811e4d749dfe3.jpg already downloaded
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd4%252Fad%252Fd4adff06d2059e4f229a2445d157f1f6%252Fpa%252FTE08681_6985fc6994c715cf6c6a6da1bc18877e.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/ad/d4adff06d2059e4f229a2445d157f1f6/pa/TE08681_6985fc6994c715cf6c6a6da1bc18877e.jpg already downloaded
2026-03-29 10:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1502214c-2353-5432-8930-45f4678b64d5, identifier: TE08681
2026-03-29 10:36:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9038a1c7-ef97-5a20-81cf-ca6fbe51d728 with identifier: GA07513
2026-03-29 10:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9038a1c7-ef97-5a20-81cf-ca6fbe51d728 with scrape type 1
2026-03-29 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9038a1c7-ef97-5a20-81cf-ca6fbe51d728
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fd8%252Fe9d85e836b0898703afe91b7f9d3b62c%252Fpa%252FGA07513_b84b60d0df9d4809472f71aa9dcdf9b5.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/d8/e9d85e836b0898703afe91b7f9d3b62c/pa/GA07513_b84b60d0df9d4809472f71aa9dcdf9b5.jpg already downloaded
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fd8%252Fe9d85e836b0898703afe91b7f9d3b62c%252Fpa%252FGA07513_af66b278dcf5089b623ae1a7920e4266.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/d8/e9d85e836b0898703afe91b7f9d3b62c/pa/GA07513_af66b278dcf5089b623ae1a7920e4266.jpg already downloaded
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fd8%252Fe9d85e836b0898703afe91b7f9d3b62c%252Fpa%252FGA07513_5bb1d803ef670e8d33f8bf0971b3f310.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/d8/e9d85e836b0898703afe91b7f9d3b62c/pa/GA07513_5bb1d803ef670e8d33f8bf0971b3f310.jpg already downloaded
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fd8%252Fe9d85e836b0898703afe91b7f9d3b62c%252Fpa%252FGA07513_27e3b19b01287714880b78594873a28f.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/d8/e9d85e836b0898703afe91b7f9d3b62c/pa/GA07513_27e3b19b01287714880b78594873a28f.jpg already downloaded
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fd8%252Fe9d85e836b0898703afe91b7f9d3b62c%252Fpa%252FGA07513_0e05d7b1b30e2587231684ebc30ffa5f.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/d8/e9d85e836b0898703afe91b7f9d3b62c/pa/GA07513_0e05d7b1b30e2587231684ebc30ffa5f.jpg already downloaded
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fd8%252Fe9d85e836b0898703afe91b7f9d3b62c%252Fpa%252FGA07513_607410e561124ad846924fe339c66319.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/d8/e9d85e836b0898703afe91b7f9d3b62c/pa/GA07513_607410e561124ad846924fe339c66319.jpg already downloaded
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fd8%252Fe9d85e836b0898703afe91b7f9d3b62c%252Fpa%252FGA07513_89d229b6a8049f4eaa9c7a17a1e5275b.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/d8/e9d85e836b0898703afe91b7f9d3b62c/pa/GA07513_89d229b6a8049f4eaa9c7a17a1e5275b.jpg already downloaded
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fd8%252Fe9d85e836b0898703afe91b7f9d3b62c%252Fpa%252FGA07513_f776cd205537f1560c37ed3eeb76fbab.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/d8/e9d85e836b0898703afe91b7f9d3b62c/pa/GA07513_f776cd205537f1560c37ed3eeb76fbab.jpg already downloaded
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fd8%252Fe9d85e836b0898703afe91b7f9d3b62c%252Fpa%252FGA07513_f17a7e25215dc146c79a9025d7fb50c7.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/d8/e9d85e836b0898703afe91b7f9d3b62c/pa/GA07513_f17a7e25215dc146c79a9025d7fb50c7.jpg already downloaded
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fd8%252Fe9d85e836b0898703afe91b7f9d3b62c%252Fpa%252FGA07513_5886c3f40b794b0646686567415bb0d6.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/d8/e9d85e836b0898703afe91b7f9d3b62c/pa/GA07513_5886c3f40b794b0646686567415bb0d6.jpg already downloaded
2026-03-29 10:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9038a1c7-ef97-5a20-81cf-ca6fbe51d728, identifier: GA07513
2026-03-29 10:36:27 [auto1.de] INFO: Found listing with ID: EK64818
2026-03-29 10:36:27 [auto1.de] INFO: Found listing with ID: XY93824
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY93824%27 HTTP/1.1" 200 None
2026-03-29 10:36:27 [auto1.de] INFO: Scrape type for XY93824: 2
2026-03-29 10:36:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd817a2e-a1d4-57d0-ab9f-9347faa4c859 with identifier: XY93824
2026-03-29 10:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd817a2e-a1d4-57d0-ab9f-9347faa4c859 with scrape type 2
2026-03-29 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd817a2e-a1d4-57d0-ab9f-9347faa4c859 with scrape type 2
2026-03-29 10:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bd817a2e-a1d4-57d0-ab9f-9347faa4c859, identifier: XY93824
2026-03-29 10:36:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1502214c-2353-5432-8930-45f4678b64d5 with identifier: TE08681
2026-03-29 10:36:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1502214c-2353-5432-8930-45f4678b64d5 with identifier: TE08681
2026-03-29 10:36:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1502214c-2353-5432-8930-45f4678b64d5 with identifier: TE08681 to the API
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TE08681>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:31:11Z',
 'fuel_type': 'petrol',
 'id': '1502214c-2353-5432-8930-45f4678b64d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE08681',
 'listing': 'auction',
 'location': 'DE, Buch',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 145829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 18,
 'photo_urls': ['https://img-pa.auto1.com/imgd4/ad/d4adff06d2059e4f229a2445d157f1f6/pa/TE08681_4cf5c2bdd1ca03318f767e16b8b5b292.jpg',
                'https://img-pa.auto1.com/imgd4/ad/d4adff06d2059e4f229a2445d157f1f6/pa/TE08681_d156e2defa6e62f33e34444d7f3526ac.jpg',
                'https://img-pa.auto1.com/imgd4/ad/d4adff06d2059e4f229a2445d157f1f6/pa/TE08681_9cb159050e08805b18994b37a1f7979f.jpg',
                'https://img-pa.auto1.com/imgd4/ad/d4adff06d2059e4f229a2445d157f1f6/pa/TE08681_ad347a42822e9834359c925f259e8948.jpg',
                'https://img-pa.auto1.com/imgd4/ad/d4adff06d2059e4f229a2445d157f1f6/pa/TE08681_f051d6dbb8f1926643c9a7cbe6d2e76b.jpg',
                'https://img-pa.auto1.com/imgd4/ad/d4adff06d2059e4f229a2445d157f1f6/pa/TE08681_8fbea88b0ea243265fa567ce3fa52635.jpg',
                'https://img-pa.auto1.com/imgd4/ad/d4adff06d2059e4f229a2445d157f1f6/pa/TE08681_db58376a619dd176f81ef6b737f79928.jpg',
                'https://img-pa.auto1.com/imgd4/ad/d4adff06d2059e4f229a2445d157f1f6/pa/TE08681_9fd3b23eb8dfc0d88691631e3bf600ca.jpg',
                'https://img-pa.auto1.com/imgd4/ad/d4adff06d2059e4f229a2445d157f1f6/pa/TE08681_bbab875ccc3b677cc87811e4d749dfe3.jpg',
                'https://img-pa.auto1.com/imgd4/ad/d4adff06d2059e4f229a2445d157f1f6/pa/TE08681_6985fc6994c715cf6c6a6da1bc18877e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1502214c-2353-5432-8930-45f4678b64d5/1502214c-2353-5432-8930-45f4678b64d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108832,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/ad/d4adff06d2059e4f229a2445d157f1f6/pa/TE08681_4cf5c2bdd1ca03318f767e16b8b5b292.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1502214c-2353-5432-8930-45f4678b64d5/1502214c-2353-5432-8930-45f4678b64d5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/ad/d4adff06d2059e4f229a2445d157f1f6/pa/TE08681_d156e2defa6e62f33e34444d7f3526ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1502214c-2353-5432-8930-45f4678b64d5/1502214c-2353-5432-8930-45f4678b64d5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/ad/d4adff06d2059e4f229a2445d157f1f6/pa/TE08681_9cb159050e08805b18994b37a1f7979f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1502214c-2353-5432-8930-45f4678b64d5/1502214c-2353-5432-8930-45f4678b64d5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/ad/d4adff06d2059e4f229a2445d157f1f6/pa/TE08681_ad347a42822e9834359c925f259e8948.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1502214c-2353-5432-8930-45f4678b64d5/1502214c-2353-5432-8930-45f4678b64d5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/ad/d4adff06d2059e4f229a2445d157f1f6/pa/TE08681_f051d6dbb8f1926643c9a7cbe6d2e76b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1502214c-2353-5432-8930-45f4678b64d5/1502214c-2353-5432-8930-45f4678b64d5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/ad/d4adff06d2059e4f229a2445d157f1f6/pa/TE08681_8fbea88b0ea243265fa567ce3fa52635.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1502214c-2353-5432-8930-45f4678b64d5/1502214c-2353-5432-8930-45f4678b64d5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/ad/d4adff06d2059e4f229a2445d157f1f6/pa/TE08681_db58376a619dd176f81ef6b737f79928.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1502214c-2353-5432-8930-45f4678b64d5/1502214c-2353-5432-8930-45f4678b64d5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/ad/d4adff06d2059e4f229a2445d157f1f6/pa/TE08681_9fd3b23eb8dfc0d88691631e3bf600ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1502214c-2353-5432-8930-45f4678b64d5/1502214c-2353-5432-8930-45f4678b64d5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/ad/d4adff06d2059e4f229a2445d157f1f6/pa/TE08681_bbab875ccc3b677cc87811e4d749dfe3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1502214c-2353-5432-8930-45f4678b64d5/1502214c-2353-5432-8930-45f4678b64d5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd4/ad/d4adff06d2059e4f229a2445d157f1f6/pa/TE08681_6985fc6994c715cf6c6a6da1bc18877e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 220 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-03-29 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE08681%27 HTTP/1.1" 200 None
2026-03-29 10:36:28 [auto1.de] INFO: Saving data for TE08681: {'created_time': 1774780588.015343, 'last_price_update_time': 1774780588.015354, 'auction_closing_time': 1774884671.0}
2026-03-29 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE08681') HTTP/1.1" 204 0
2026-03-29 10:36:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9038a1c7-ef97-5a20-81cf-ca6fbe51d728 with identifier: GA07513
2026-03-29 10:36:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9038a1c7-ef97-5a20-81cf-ca6fbe51d728 with identifier: GA07513
2026-03-29 10:36:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9038a1c7-ef97-5a20-81cf-ca6fbe51d728 with identifier: GA07513 to the API
2026-03-29 10:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GA07513>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:28:23Z',
 'fuel_type': 'diesel',
 'id': '9038a1c7-ef97-5a20-81cf-ca6fbe51d728',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA07513',
 'listing': 'auction',
 'location': 'DE, Überherrn',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 146033,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge9/d8/e9d85e836b0898703afe91b7f9d3b62c/pa/GA07513_b84b60d0df9d4809472f71aa9dcdf9b5.jpg',
                'https://img-pa.auto1.com/imge9/d8/e9d85e836b0898703afe91b7f9d3b62c/pa/GA07513_af66b278dcf5089b623ae1a7920e4266.jpg',
                'https://img-pa.auto1.com/imge9/d8/e9d85e836b0898703afe91b7f9d3b62c/pa/GA07513_5bb1d803ef670e8d33f8bf0971b3f310.jpg',
                'https://img-pa.auto1.com/imge9/d8/e9d85e836b0898703afe91b7f9d3b62c/pa/GA07513_27e3b19b01287714880b78594873a28f.jpg',
                'https://img-pa.auto1.com/imge9/d8/e9d85e836b0898703afe91b7f9d3b62c/pa/GA07513_0e05d7b1b30e2587231684ebc30ffa5f.jpg',
                'https://img-pa.auto1.com/imge9/d8/e9d85e836b0898703afe91b7f9d3b62c/pa/GA07513_607410e561124ad846924fe339c66319.jpg',
                'https://img-pa.auto1.com/imge9/d8/e9d85e836b0898703afe91b7f9d3b62c/pa/GA07513_89d229b6a8049f4eaa9c7a17a1e5275b.jpg',
                'https://img-pa.auto1.com/imge9/d8/e9d85e836b0898703afe91b7f9d3b62c/pa/GA07513_f776cd205537f1560c37ed3eeb76fbab.jpg',
                'https://img-pa.auto1.com/imge9/d8/e9d85e836b0898703afe91b7f9d3b62c/pa/GA07513_f17a7e25215dc146c79a9025d7fb50c7.jpg',
                'https://img-pa.auto1.com/imge9/d8/e9d85e836b0898703afe91b7f9d3b62c/pa/GA07513_5886c3f40b794b0646686567415bb0d6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9038a1c7-ef97-5a20-81cf-ca6fbe51d728/9038a1c7-ef97-5a20-81cf-ca6fbe51d728_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/d8/e9d85e836b0898703afe91b7f9d3b62c/pa/GA07513_b84b60d0df9d4809472f71aa9dcdf9b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9038a1c7-ef97-5a20-81cf-ca6fbe51d728/9038a1c7-ef97-5a20-81cf-ca6fbe51d728_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/d8/e9d85e836b0898703afe91b7f9d3b62c/pa/GA07513_af66b278dcf5089b623ae1a7920e4266.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9038a1c7-ef97-5a20-81cf-ca6fbe51d728/9038a1c7-ef97-5a20-81cf-ca6fbe51d728_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/d8/e9d85e836b0898703afe91b7f9d3b62c/pa/GA07513_5bb1d803ef670e8d33f8bf0971b3f310.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9038a1c7-ef97-5a20-81cf-ca6fbe51d728/9038a1c7-ef97-5a20-81cf-ca6fbe51d728_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/d8/e9d85e836b0898703afe91b7f9d3b62c/pa/GA07513_27e3b19b01287714880b78594873a28f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9038a1c7-ef97-5a20-81cf-ca6fbe51d728/9038a1c7-ef97-5a20-81cf-ca6fbe51d728_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/d8/e9d85e836b0898703afe91b7f9d3b62c/pa/GA07513_0e05d7b1b30e2587231684ebc30ffa5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9038a1c7-ef97-5a20-81cf-ca6fbe51d728/9038a1c7-ef97-5a20-81cf-ca6fbe51d728_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66995,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/d8/e9d85e836b0898703afe91b7f9d3b62c/pa/GA07513_607410e561124ad846924fe339c66319.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9038a1c7-ef97-5a20-81cf-ca6fbe51d728/9038a1c7-ef97-5a20-81cf-ca6fbe51d728_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63991,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/d8/e9d85e836b0898703afe91b7f9d3b62c/pa/GA07513_89d229b6a8049f4eaa9c7a17a1e5275b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9038a1c7-ef97-5a20-81cf-ca6fbe51d728/9038a1c7-ef97-5a20-81cf-ca6fbe51d728_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/d8/e9d85e836b0898703afe91b7f9d3b62c/pa/GA07513_f776cd205537f1560c37ed3eeb76fbab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9038a1c7-ef97-5a20-81cf-ca6fbe51d728/9038a1c7-ef97-5a20-81cf-ca6fbe51d728_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/d8/e9d85e836b0898703afe91b7f9d3b62c/pa/GA07513_f17a7e25215dc146c79a9025d7fb50c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9038a1c7-ef97-5a20-81cf-ca6fbe51d728/9038a1c7-ef97-5a20-81cf-ca6fbe51d728_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/d8/e9d85e836b0898703afe91b7f9d3b62c/pa/GA07513_5886c3f40b794b0646686567415bb0d6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-29 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA07513%27 HTTP/1.1" 200 None
2026-03-29 10:36:28 [auto1.de] INFO: Saving data for GA07513: {'created_time': 1774780588.340606, 'last_price_update_time': 1774780588.340616, 'auction_closing_time': 1774884503.0}
2026-03-29 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA07513') HTTP/1.1" 204 0
2026-03-29 10:36:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bd817a2e-a1d4-57d0-ab9f-9347faa4c859 with identifier: XY93824
2026-03-29 10:36:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bd817a2e-a1d4-57d0-ab9f-9347faa4c859 with identifier: XY93824
2026-03-29 10:36:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bd817a2e-a1d4-57d0-ab9f-9347faa4c859 with identifier: XY93824 to the API
2026-03-29 10:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:56:58Z',
 'fuel_type': 'diesel',
 'id': 'bd817a2e-a1d4-57d0-ab9f-9347faa4c859',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY93824',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Viano',
 'odometer': 132615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-04',
 'seller_name': None,
 'title': 'Mercedes-Benz Viano 3.0 CDI kompakt Ambiente Edition',
 'transmission': 'automatic',
 'trim': 'kompakt Ambiente Edition',
 'year': 2010}
2026-03-29 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY93824%27 HTTP/1.1" 200 None
2026-03-29 10:36:28 [auto1.de] INFO: Saving data for XY93824: {'auction_closing_time': 1774886218.0, 'created_time': 1774550895.370796, 'last_price_update_time': 1774780588.712492}
2026-03-29 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY93824') HTTP/1.1" 204 0
2026-03-29 10:36:28 [auto1.de] INFO: Found listing with ID: UD27058
2026-03-29 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD27058%27 HTTP/1.1" 200 None
2026-03-29 10:36:28 [auto1.de] INFO: Scrape type for UD27058: 2
2026-03-29 10:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af667184-c0c7-52b3-a9f9-3d31c374f588 with identifier: UD27058
2026-03-29 10:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af667184-c0c7-52b3-a9f9-3d31c374f588 with scrape type 2
2026-03-29 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af667184-c0c7-52b3-a9f9-3d31c374f588 with scrape type 2
2026-03-29 10:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af667184-c0c7-52b3-a9f9-3d31c374f588, identifier: UD27058
2026-03-29 10:36:28 [auto1.de] INFO: Found listing with ID: AT28488
2026-03-29 10:36:28 [auto1.de] INFO: Found listing with ID: YW90897
2026-03-29 10:36:28 [auto1.de] INFO: Found listing with ID: YB70330
2026-03-29 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB70330%27 HTTP/1.1" 200 None
2026-03-29 10:36:28 [auto1.de] INFO: Scrape type for YB70330: 2
2026-03-29 10:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9aae4af9-eae4-5a6b-ab52-ef808ab8c3d6 with identifier: YB70330
2026-03-29 10:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9aae4af9-eae4-5a6b-ab52-ef808ab8c3d6 with scrape type 2
2026-03-29 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9aae4af9-eae4-5a6b-ab52-ef808ab8c3d6 with scrape type 2
2026-03-29 10:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9aae4af9-eae4-5a6b-ab52-ef808ab8c3d6, identifier: YB70330
2026-03-29 10:36:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af667184-c0c7-52b3-a9f9-3d31c374f588 with identifier: UD27058
2026-03-29 10:36:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af667184-c0c7-52b3-a9f9-3d31c374f588 with identifier: UD27058
2026-03-29 10:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af667184-c0c7-52b3-a9f9-3d31c374f588 with identifier: UD27058 to the API
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:51:06Z',
 'fuel_type': 'petrol',
 'id': 'af667184-c0c7-52b3-a9f9-3d31c374f588',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD27058',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 149804,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-05',
 'seller_name': None,
 'title': 'Skoda Superb 1.8 TSI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2013}
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD27058%27 HTTP/1.1" 200 None
2026-03-29 10:36:29 [auto1.de] INFO: Saving data for UD27058: {'auction_closing_time': 1774885866.0, 'created_time': 1773686331.940242, 'last_price_update_time': 1774780589.279546}
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UD27058') HTTP/1.1" 204 0
2026-03-29 10:36:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VE07121> (referer: https://www.auto1.com/v1/car-details-view/VE07121/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c with identifier: NB51359
2026-03-29 10:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c with scrape type 1
2026-03-29 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F4a%252F504a5b692fc4d7ef12e1327911b4b3f8%252Fpa%252FNB51359_51ae6e1b4508f420dec674d409d4b736.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/4a/504a5b692fc4d7ef12e1327911b4b3f8/pa/NB51359_51ae6e1b4508f420dec674d409d4b736.jpg already downloaded
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F4a%252F504a5b692fc4d7ef12e1327911b4b3f8%252Fpa%252FNB51359_0ecf227a02c550e6fbe73541a44260b6.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/4a/504a5b692fc4d7ef12e1327911b4b3f8/pa/NB51359_0ecf227a02c550e6fbe73541a44260b6.jpg already downloaded
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F4a%252F504a5b692fc4d7ef12e1327911b4b3f8%252Fpa%252FNB51359_92d52fd111ee817e2dc72ccdb1ddae22.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/4a/504a5b692fc4d7ef12e1327911b4b3f8/pa/NB51359_92d52fd111ee817e2dc72ccdb1ddae22.jpg already downloaded
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F4a%252F504a5b692fc4d7ef12e1327911b4b3f8%252Fpa%252FNB51359_ac79d5b65a93f83a43ba88e31d78dcbe.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/4a/504a5b692fc4d7ef12e1327911b4b3f8/pa/NB51359_ac79d5b65a93f83a43ba88e31d78dcbe.jpg already downloaded
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F4a%252F504a5b692fc4d7ef12e1327911b4b3f8%252Fpa%252FNB51359_7994156ee669cba3b5208c5875fec705.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/4a/504a5b692fc4d7ef12e1327911b4b3f8/pa/NB51359_7994156ee669cba3b5208c5875fec705.jpg already downloaded
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F4a%252F504a5b692fc4d7ef12e1327911b4b3f8%252Fpa%252FNB51359_e4b246aa388d23de3829acdabdfd8c59.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/4a/504a5b692fc4d7ef12e1327911b4b3f8/pa/NB51359_e4b246aa388d23de3829acdabdfd8c59.jpg already downloaded
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F4a%252F504a5b692fc4d7ef12e1327911b4b3f8%252Fpa%252FNB51359_da146bcdca54282216c01a03e79ca445.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/4a/504a5b692fc4d7ef12e1327911b4b3f8/pa/NB51359_da146bcdca54282216c01a03e79ca445.jpg already downloaded
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F4a%252F504a5b692fc4d7ef12e1327911b4b3f8%252Fpa%252FNB51359_a2aba3bdb4cb800adb39e622bc8d1d86.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/4a/504a5b692fc4d7ef12e1327911b4b3f8/pa/NB51359_a2aba3bdb4cb800adb39e622bc8d1d86.jpg already downloaded
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F4a%252F504a5b692fc4d7ef12e1327911b4b3f8%252Fpa%252FNB51359_a0d31a3b9360e3919c43b183f47d6e70.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/4a/504a5b692fc4d7ef12e1327911b4b3f8/pa/NB51359_a0d31a3b9360e3919c43b183f47d6e70.jpg already downloaded
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F4a%252F504a5b692fc4d7ef12e1327911b4b3f8%252Fpa%252FNB51359_c8bdc814434b736c866079630574a77d.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/4a/504a5b692fc4d7ef12e1327911b4b3f8/pa/NB51359_c8bdc814434b736c866079630574a77d.jpg already downloaded
2026-03-29 10:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c, identifier: NB51359
2026-03-29 10:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9aae4af9-eae4-5a6b-ab52-ef808ab8c3d6 with identifier: YB70330
2026-03-29 10:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9aae4af9-eae4-5a6b-ab52-ef808ab8c3d6 with identifier: YB70330
2026-03-29 10:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9aae4af9-eae4-5a6b-ab52-ef808ab8c3d6 with identifier: YB70330 to the API
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:13:42Z',
 'fuel_type': 'diesel',
 'id': '9aae4af9-eae4-5a6b-ab52-ef808ab8c3d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB70330',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 76342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-11',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 TDCi EcoBlue ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2021}
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB70330%27 HTTP/1.1" 200 None
2026-03-29 10:36:30 [auto1.de] INFO: Saving data for YB70330: {'auction_closing_time': 1774883622.0, 'created_time': 1773516443.020229, 'last_price_update_time': 1774780590.079573}
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YB70330') HTTP/1.1" 204 0
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: VV98645
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV98645%27 HTTP/1.1" 200 None
2026-03-29 10:36:30 [auto1.de] INFO: Scrape type for VV98645: 0
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: JG12226
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: UV43425
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: MH98673
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH98673%27 HTTP/1.1" 200 None
2026-03-29 10:36:30 [auto1.de] INFO: Scrape type for MH98673: 1
2026-03-29 10:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZJ67042/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c with identifier: NB51359
2026-03-29 10:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c with identifier: NB51359
2026-03-29 10:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c with identifier: NB51359 to the API
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NB51359>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:16:27Z',
 'fuel_type': 'diesel',
 'id': '6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB51359',
 'listing': 'auction',
 'location': 'DE, Helvesiek',
 'make': 'Volvo',
 'model': 'XC70',
 'odometer': 76956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/img50/4a/504a5b692fc4d7ef12e1327911b4b3f8/pa/NB51359_51ae6e1b4508f420dec674d409d4b736.jpg',
                'https://img-pa.auto1.com/img50/4a/504a5b692fc4d7ef12e1327911b4b3f8/pa/NB51359_0ecf227a02c550e6fbe73541a44260b6.jpg',
                'https://img-pa.auto1.com/img50/4a/504a5b692fc4d7ef12e1327911b4b3f8/pa/NB51359_92d52fd111ee817e2dc72ccdb1ddae22.jpg',
                'https://img-pa.auto1.com/img50/4a/504a5b692fc4d7ef12e1327911b4b3f8/pa/NB51359_ac79d5b65a93f83a43ba88e31d78dcbe.jpg',
                'https://img-pa.auto1.com/img50/4a/504a5b692fc4d7ef12e1327911b4b3f8/pa/NB51359_7994156ee669cba3b5208c5875fec705.jpg',
                'https://img-pa.auto1.com/img50/4a/504a5b692fc4d7ef12e1327911b4b3f8/pa/NB51359_e4b246aa388d23de3829acdabdfd8c59.jpg',
                'https://img-pa.auto1.com/img50/4a/504a5b692fc4d7ef12e1327911b4b3f8/pa/NB51359_da146bcdca54282216c01a03e79ca445.jpg',
                'https://img-pa.auto1.com/img50/4a/504a5b692fc4d7ef12e1327911b4b3f8/pa/NB51359_a2aba3bdb4cb800adb39e622bc8d1d86.jpg',
                'https://img-pa.auto1.com/img50/4a/504a5b692fc4d7ef12e1327911b4b3f8/pa/NB51359_a0d31a3b9360e3919c43b183f47d6e70.jpg',
                'https://img-pa.auto1.com/img50/4a/504a5b692fc4d7ef12e1327911b4b3f8/pa/NB51359_c8bdc814434b736c866079630574a77d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c/6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/4a/504a5b692fc4d7ef12e1327911b4b3f8/pa/NB51359_51ae6e1b4508f420dec674d409d4b736.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c/6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/4a/504a5b692fc4d7ef12e1327911b4b3f8/pa/NB51359_0ecf227a02c550e6fbe73541a44260b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c/6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/4a/504a5b692fc4d7ef12e1327911b4b3f8/pa/NB51359_92d52fd111ee817e2dc72ccdb1ddae22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c/6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/4a/504a5b692fc4d7ef12e1327911b4b3f8/pa/NB51359_ac79d5b65a93f83a43ba88e31d78dcbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c/6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/4a/504a5b692fc4d7ef12e1327911b4b3f8/pa/NB51359_7994156ee669cba3b5208c5875fec705.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c/6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/4a/504a5b692fc4d7ef12e1327911b4b3f8/pa/NB51359_e4b246aa388d23de3829acdabdfd8c59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c/6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/4a/504a5b692fc4d7ef12e1327911b4b3f8/pa/NB51359_da146bcdca54282216c01a03e79ca445.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c/6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/4a/504a5b692fc4d7ef12e1327911b4b3f8/pa/NB51359_a2aba3bdb4cb800adb39e622bc8d1d86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c/6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83893,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/4a/504a5b692fc4d7ef12e1327911b4b3f8/pa/NB51359_a0d31a3b9360e3919c43b183f47d6e70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c/6a83e89f-89c8-54eb-aa41-4bfdcd70bf4c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/4a/504a5b692fc4d7ef12e1327911b4b3f8/pa/NB51359_c8bdc814434b736c866079630574a77d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-05-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC70 2.0 D4 Momentum 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum 2WD',
 'year': 2014}
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB51359%27 HTTP/1.1" 200 None
2026-03-29 10:36:30 [auto1.de] INFO: Saving data for NB51359: {'created_time': 1774780590.512146, 'last_price_update_time': 1774780590.512157, 'auction_closing_time': 1774883787.0}
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB51359') HTTP/1.1" 204 0
2026-03-29 10:36:30 [auto1.de] INFO: Found listing with ID: CJ04557
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ04557%27 HTTP/1.1" 200 None
2026-03-29 10:36:30 [auto1.de] INFO: Scrape type for CJ04557: 2
2026-03-29 10:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 401546a5-dcc2-5886-9f19-65097dc6df95 with identifier: CJ04557
2026-03-29 10:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 401546a5-dcc2-5886-9f19-65097dc6df95 with scrape type 2
2026-03-29 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 401546a5-dcc2-5886-9f19-65097dc6df95 with scrape type 2
2026-03-29 10:36:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 401546a5-dcc2-5886-9f19-65097dc6df95, identifier: CJ04557
2026-03-29 10:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 401546a5-dcc2-5886-9f19-65097dc6df95 with identifier: CJ04557
2026-03-29 10:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 401546a5-dcc2-5886-9f19-65097dc6df95 with identifier: CJ04557
2026-03-29 10:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 401546a5-dcc2-5886-9f19-65097dc6df95 with identifier: CJ04557 to the API
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:41:32Z',
 'fuel_type': 'diesel',
 'id': '401546a5-dcc2-5886-9f19-65097dc6df95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ04557',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 273024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-08-30',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.9 TDI BlueMotion',
 'transmission': 'manual',
 'trim': 'BlueMotion',
 'year': 2007}
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ04557%27 HTTP/1.1" 200 None
2026-03-29 10:36:30 [auto1.de] INFO: Saving data for CJ04557: {'auction_closing_time': 1774885292.0, 'created_time': 1774638257.049201, 'last_price_update_time': 1774780590.973507}
2026-03-29 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CJ04557') HTTP/1.1" 204 0
2026-03-29 10:36:31 [auto1.de] INFO: Found listing with ID: LD99689
2026-03-29 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD99689%27 HTTP/1.1" 200 None
2026-03-29 10:36:31 [auto1.de] INFO: Scrape type for LD99689: 2
2026-03-29 10:36:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3779838b-9f43-521d-bc3d-4bf4803594b5 with identifier: LD99689
2026-03-29 10:36:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3779838b-9f43-521d-bc3d-4bf4803594b5 with scrape type 2
2026-03-29 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3779838b-9f43-521d-bc3d-4bf4803594b5 with scrape type 2
2026-03-29 10:36:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3779838b-9f43-521d-bc3d-4bf4803594b5, identifier: LD99689
2026-03-29 10:36:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3779838b-9f43-521d-bc3d-4bf4803594b5 with identifier: LD99689
2026-03-29 10:36:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3779838b-9f43-521d-bc3d-4bf4803594b5 with identifier: LD99689
2026-03-29 10:36:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3779838b-9f43-521d-bc3d-4bf4803594b5 with identifier: LD99689 to the API
2026-03-29 10:36:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:28:57Z',
 'fuel_type': 'petrol',
 'id': '3779838b-9f43-521d-bc3d-4bf4803594b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD99689',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Signum',
 'odometer': 162415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-12-27',
 'seller_name': None,
 'title': 'Opel Signum 1.8 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2006}
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD99689%27 HTTP/1.1" 200 None
2026-03-29 10:36:32 [auto1.de] INFO: Saving data for LD99689: {'auction_closing_time': 1774884537.0, 'created_time': 1773427007.012836, 'last_price_update_time': 1774780592.099283}
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LD99689') HTTP/1.1" 204 0
2026-03-29 10:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BS02635> (referer: https://www.auto1.com/v1/car-details-view/BS02635/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RR70760> (referer: https://www.auto1.com/v1/car-details-view/RR70760/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HB92022> (referer: https://www.auto1.com/v1/car-details-view/HB92022/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d51a362-f20f-5d31-af0d-5811cb785dd0 with identifier: VE07121
2026-03-29 10:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d51a362-f20f-5d31-af0d-5811cb785dd0 with scrape type 1
2026-03-29 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0d51a362-f20f-5d31-af0d-5811cb785dd0
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F2e%252Fbe2e86964c51c3906f78413bcde9c0f9%252Fpa%252FVE07121_c5eb3a6f91105a2d5743bf43eda672d9.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/2e/be2e86964c51c3906f78413bcde9c0f9/pa/VE07121_c5eb3a6f91105a2d5743bf43eda672d9.jpg already downloaded
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F2e%252Fbe2e86964c51c3906f78413bcde9c0f9%252Fpa%252FVE07121_e9dd7e2775e7f7141ae4a37a85d5cb5a.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/2e/be2e86964c51c3906f78413bcde9c0f9/pa/VE07121_e9dd7e2775e7f7141ae4a37a85d5cb5a.jpg already downloaded
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F2e%252Fbe2e86964c51c3906f78413bcde9c0f9%252Fpa%252FVE07121_4f94e933a49fe6c3e407f415d062c400.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/2e/be2e86964c51c3906f78413bcde9c0f9/pa/VE07121_4f94e933a49fe6c3e407f415d062c400.jpg already downloaded
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F2e%252Fbe2e86964c51c3906f78413bcde9c0f9%252Fpa%252FVE07121_bcfd2b9ace0bc95057860f00449094db.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/2e/be2e86964c51c3906f78413bcde9c0f9/pa/VE07121_bcfd2b9ace0bc95057860f00449094db.jpg already downloaded
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F2e%252Fbe2e86964c51c3906f78413bcde9c0f9%252Fpa%252FVE07121_9051d2c3ea882874465269c5232f46c3.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/2e/be2e86964c51c3906f78413bcde9c0f9/pa/VE07121_9051d2c3ea882874465269c5232f46c3.jpg already downloaded
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F2e%252Fbe2e86964c51c3906f78413bcde9c0f9%252Fpa%252FVE07121_0efb11a5615c3440691b8d4b8e1f573a.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/2e/be2e86964c51c3906f78413bcde9c0f9/pa/VE07121_0efb11a5615c3440691b8d4b8e1f573a.jpg already downloaded
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F2e%252Fbe2e86964c51c3906f78413bcde9c0f9%252Fpa%252FVE07121_9dd7d0e3c60de2478cc3393f7ec8a9d6.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/2e/be2e86964c51c3906f78413bcde9c0f9/pa/VE07121_9dd7d0e3c60de2478cc3393f7ec8a9d6.jpg already downloaded
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F2e%252Fbe2e86964c51c3906f78413bcde9c0f9%252Fpa%252FVE07121_42b9a552ec1a3d8c2702ad05e8c9fbb3.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/2e/be2e86964c51c3906f78413bcde9c0f9/pa/VE07121_42b9a552ec1a3d8c2702ad05e8c9fbb3.jpg already downloaded
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F2e%252Fbe2e86964c51c3906f78413bcde9c0f9%252Fpa%252FVE07121_cee45556079ad87ba21960f67be1c3c4.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/2e/be2e86964c51c3906f78413bcde9c0f9/pa/VE07121_cee45556079ad87ba21960f67be1c3c4.jpg already downloaded
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F2e%252Fbe2e86964c51c3906f78413bcde9c0f9%252Fpa%252FVE07121_dbc742a811de23da367b6fe51a545e83.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/2e/be2e86964c51c3906f78413bcde9c0f9/pa/VE07121_dbc742a811de23da367b6fe51a545e83.jpg already downloaded
2026-03-29 10:36:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d51a362-f20f-5d31-af0d-5811cb785dd0, identifier: VE07121
2026-03-29 10:36:32 [auto1.de] INFO: Found listing with ID: JM98796
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM98796%27 HTTP/1.1" 200 None
2026-03-29 10:36:32 [auto1.de] INFO: Scrape type for JM98796: 2
2026-03-29 10:36:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cacc1a32-7d9a-5a9e-9cd3-f2e16990ca62 with identifier: JM98796
2026-03-29 10:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cacc1a32-7d9a-5a9e-9cd3-f2e16990ca62 with scrape type 2
2026-03-29 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cacc1a32-7d9a-5a9e-9cd3-f2e16990ca62 with scrape type 2
2026-03-29 10:36:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cacc1a32-7d9a-5a9e-9cd3-f2e16990ca62, identifier: JM98796
2026-03-29 10:36:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d51a362-f20f-5d31-af0d-5811cb785dd0 with identifier: VE07121
2026-03-29 10:36:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d51a362-f20f-5d31-af0d-5811cb785dd0 with identifier: VE07121
2026-03-29 10:36:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d51a362-f20f-5d31-af0d-5811cb785dd0 with identifier: VE07121 to the API
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VE07121>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 272,
 'expiration_date': '2026-03-30T15:45:16Z',
 'fuel_type': 'diesel',
 'id': '0d51a362-f20f-5d31-af0d-5811cb785dd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE07121',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 103309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgbe/2e/be2e86964c51c3906f78413bcde9c0f9/pa/VE07121_c5eb3a6f91105a2d5743bf43eda672d9.jpg',
                'https://img-pa.auto1.com/imgbe/2e/be2e86964c51c3906f78413bcde9c0f9/pa/VE07121_e9dd7e2775e7f7141ae4a37a85d5cb5a.jpg',
                'https://img-pa.auto1.com/imgbe/2e/be2e86964c51c3906f78413bcde9c0f9/pa/VE07121_4f94e933a49fe6c3e407f415d062c400.jpg',
                'https://img-pa.auto1.com/imgbe/2e/be2e86964c51c3906f78413bcde9c0f9/pa/VE07121_bcfd2b9ace0bc95057860f00449094db.jpg',
                'https://img-pa.auto1.com/imgbe/2e/be2e86964c51c3906f78413bcde9c0f9/pa/VE07121_9051d2c3ea882874465269c5232f46c3.jpg',
                'https://img-pa.auto1.com/imgbe/2e/be2e86964c51c3906f78413bcde9c0f9/pa/VE07121_0efb11a5615c3440691b8d4b8e1f573a.jpg',
                'https://img-pa.auto1.com/imgbe/2e/be2e86964c51c3906f78413bcde9c0f9/pa/VE07121_9dd7d0e3c60de2478cc3393f7ec8a9d6.jpg',
                'https://img-pa.auto1.com/imgbe/2e/be2e86964c51c3906f78413bcde9c0f9/pa/VE07121_42b9a552ec1a3d8c2702ad05e8c9fbb3.jpg',
                'https://img-pa.auto1.com/imgbe/2e/be2e86964c51c3906f78413bcde9c0f9/pa/VE07121_cee45556079ad87ba21960f67be1c3c4.jpg',
                'https://img-pa.auto1.com/imgbe/2e/be2e86964c51c3906f78413bcde9c0f9/pa/VE07121_dbc742a811de23da367b6fe51a545e83.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d51a362-f20f-5d31-af0d-5811cb785dd0/0d51a362-f20f-5d31-af0d-5811cb785dd0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74005,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/2e/be2e86964c51c3906f78413bcde9c0f9/pa/VE07121_c5eb3a6f91105a2d5743bf43eda672d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d51a362-f20f-5d31-af0d-5811cb785dd0/0d51a362-f20f-5d31-af0d-5811cb785dd0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71991,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/2e/be2e86964c51c3906f78413bcde9c0f9/pa/VE07121_e9dd7e2775e7f7141ae4a37a85d5cb5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d51a362-f20f-5d31-af0d-5811cb785dd0/0d51a362-f20f-5d31-af0d-5811cb785dd0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/2e/be2e86964c51c3906f78413bcde9c0f9/pa/VE07121_4f94e933a49fe6c3e407f415d062c400.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d51a362-f20f-5d31-af0d-5811cb785dd0/0d51a362-f20f-5d31-af0d-5811cb785dd0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59251,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/2e/be2e86964c51c3906f78413bcde9c0f9/pa/VE07121_bcfd2b9ace0bc95057860f00449094db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d51a362-f20f-5d31-af0d-5811cb785dd0/0d51a362-f20f-5d31-af0d-5811cb785dd0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/2e/be2e86964c51c3906f78413bcde9c0f9/pa/VE07121_9051d2c3ea882874465269c5232f46c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d51a362-f20f-5d31-af0d-5811cb785dd0/0d51a362-f20f-5d31-af0d-5811cb785dd0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/2e/be2e86964c51c3906f78413bcde9c0f9/pa/VE07121_0efb11a5615c3440691b8d4b8e1f573a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d51a362-f20f-5d31-af0d-5811cb785dd0/0d51a362-f20f-5d31-af0d-5811cb785dd0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/2e/be2e86964c51c3906f78413bcde9c0f9/pa/VE07121_9dd7d0e3c60de2478cc3393f7ec8a9d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d51a362-f20f-5d31-af0d-5811cb785dd0/0d51a362-f20f-5d31-af0d-5811cb785dd0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/2e/be2e86964c51c3906f78413bcde9c0f9/pa/VE07121_42b9a552ec1a3d8c2702ad05e8c9fbb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d51a362-f20f-5d31-af0d-5811cb785dd0/0d51a362-f20f-5d31-af0d-5811cb785dd0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76649,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/2e/be2e86964c51c3906f78413bcde9c0f9/pa/VE07121_cee45556079ad87ba21960f67be1c3c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d51a362-f20f-5d31-af0d-5811cb785dd0/0d51a362-f20f-5d31-af0d-5811cb785dd0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/2e/be2e86964c51c3906f78413bcde9c0f9/pa/VE07121_dbc742a811de23da367b6fe51a545e83.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 3.0 V6 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2016}
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE07121%27 HTTP/1.1" 200 None
2026-03-29 10:36:32 [auto1.de] INFO: Saving data for VE07121: {'created_time': 1774780592.930006, 'last_price_update_time': 1774780592.930016, 'auction_closing_time': 1774885516.0}
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE07121') HTTP/1.1" 204 0
2026-03-29 10:36:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cacc1a32-7d9a-5a9e-9cd3-f2e16990ca62 with identifier: JM98796
2026-03-29 10:36:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cacc1a32-7d9a-5a9e-9cd3-f2e16990ca62 with identifier: JM98796
2026-03-29 10:36:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cacc1a32-7d9a-5a9e-9cd3-f2e16990ca62 with identifier: JM98796 to the API
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:39:24Z',
 'fuel_type': 'petrol',
 'id': 'cacc1a32-7d9a-5a9e-9cd3-f2e16990ca62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM98796',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 180438,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-23',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 170 NGT Taxi',
 'transmission': 'automatic',
 'trim': 'Taxi',
 'year': 2008}
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM98796%27 HTTP/1.1" 200 None
2026-03-29 10:36:33 [auto1.de] INFO: Saving data for JM98796: {'auction_closing_time': 1774885164.0, 'created_time': 1773571885.313575, 'last_price_update_time': 1774780593.27291}
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM98796') HTTP/1.1" 204 0
2026-03-29 10:36:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:33 [auto1.de] INFO: Found listing with ID: CZ09643
2026-03-29 10:36:33 [auto1.de] INFO: Found listing with ID: LZ98247
2026-03-29 10:36:33 [auto1.de] INFO: Found listing with ID: VM39350
2026-03-29 10:36:33 [auto1.de] INFO: Found listing with ID: TB49409
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB49409%27 HTTP/1.1" 200 None
2026-03-29 10:36:33 [auto1.de] INFO: Scrape type for TB49409: 2
2026-03-29 10:36:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 151649a1-64ec-577d-8c80-9c111bcb75bc with identifier: TB49409
2026-03-29 10:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 151649a1-64ec-577d-8c80-9c111bcb75bc with scrape type 2
2026-03-29 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 151649a1-64ec-577d-8c80-9c111bcb75bc with scrape type 2
2026-03-29 10:36:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 151649a1-64ec-577d-8c80-9c111bcb75bc, identifier: TB49409
2026-03-29 10:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GT54138/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ed4827e-63ff-52fd-b656-73d08d805143 with identifier: BS02635
2026-03-29 10:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ed4827e-63ff-52fd-b656-73d08d805143 with scrape type 1
2026-03-29 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4ed4827e-63ff-52fd-b656-73d08d805143
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F53%252Fb5535ddafe2ae376338e8facb4473760%252Fpa%252FBS02635_ca7fc44eb7ca1a4d4dbe40c7a55bc40e.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/53/b5535ddafe2ae376338e8facb4473760/pa/BS02635_ca7fc44eb7ca1a4d4dbe40c7a55bc40e.jpg already downloaded
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F53%252Fb5535ddafe2ae376338e8facb4473760%252Fpa%252FBS02635_3b754a5c034bcfdc4e3e311ebfb415b8.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/53/b5535ddafe2ae376338e8facb4473760/pa/BS02635_3b754a5c034bcfdc4e3e311ebfb415b8.jpg already downloaded
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F53%252Fb5535ddafe2ae376338e8facb4473760%252Fpa%252FBS02635_07439fd9ead07b82cf7756c0668bd4ae.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/53/b5535ddafe2ae376338e8facb4473760/pa/BS02635_07439fd9ead07b82cf7756c0668bd4ae.jpg already downloaded
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F53%252Fb5535ddafe2ae376338e8facb4473760%252Fpa%252FBS02635_dce73f4549ab5efbf29d29915c3b07ce.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/53/b5535ddafe2ae376338e8facb4473760/pa/BS02635_dce73f4549ab5efbf29d29915c3b07ce.jpg already downloaded
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F53%252Fb5535ddafe2ae376338e8facb4473760%252Fpa%252FBS02635_b8654b4b0eb56a9d2eaa8d1a0ceabf95.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/53/b5535ddafe2ae376338e8facb4473760/pa/BS02635_b8654b4b0eb56a9d2eaa8d1a0ceabf95.jpg already downloaded
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F53%252Fb5535ddafe2ae376338e8facb4473760%252Fpa%252FBS02635_1d91e8aad6f673c0e17fc57066f25bf0.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/53/b5535ddafe2ae376338e8facb4473760/pa/BS02635_1d91e8aad6f673c0e17fc57066f25bf0.jpg already downloaded
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F53%252Fb5535ddafe2ae376338e8facb4473760%252Fpa%252FBS02635_fd917481cba4f0c8b8e73bebdfbdf72f.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/53/b5535ddafe2ae376338e8facb4473760/pa/BS02635_fd917481cba4f0c8b8e73bebdfbdf72f.jpg already downloaded
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F53%252Fb5535ddafe2ae376338e8facb4473760%252Fpa%252FBS02635_2b453a7d317ef2cd776ae054d79ff88d.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/53/b5535ddafe2ae376338e8facb4473760/pa/BS02635_2b453a7d317ef2cd776ae054d79ff88d.jpg already downloaded
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F53%252Fb5535ddafe2ae376338e8facb4473760%252Fpa%252FBS02635_35338d4c28c504e368ebd6b7790563ec.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/53/b5535ddafe2ae376338e8facb4473760/pa/BS02635_35338d4c28c504e368ebd6b7790563ec.jpg already downloaded
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F53%252Fb5535ddafe2ae376338e8facb4473760%252Fpa%252FBS02635_18fb2d032de2b950365fa034b853479e.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/53/b5535ddafe2ae376338e8facb4473760/pa/BS02635_18fb2d032de2b950365fa034b853479e.jpg already downloaded
2026-03-29 10:36:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ed4827e-63ff-52fd-b656-73d08d805143, identifier: BS02635
2026-03-29 10:36:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3aa40cf4-1b93-5bba-b866-f8bee9729b02 with identifier: RR70760
2026-03-29 10:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3aa40cf4-1b93-5bba-b866-f8bee9729b02 with scrape type 1
2026-03-29 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3aa40cf4-1b93-5bba-b866-f8bee9729b02
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F04%252F9e042586f1d915b0bf5d1b48f963299f%252Fpa%252FRR70760_49b1fdad220b9c704e600794406d605d.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/04/9e042586f1d915b0bf5d1b48f963299f/pa/RR70760_49b1fdad220b9c704e600794406d605d.jpg already downloaded
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F04%252F9e042586f1d915b0bf5d1b48f963299f%252Fpa%252FRR70760_190d4ed4c766c238ecaed59724275e6c.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/04/9e042586f1d915b0bf5d1b48f963299f/pa/RR70760_190d4ed4c766c238ecaed59724275e6c.jpg already downloaded
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F04%252F9e042586f1d915b0bf5d1b48f963299f%252Fpa%252FRR70760_9c1eb29f5367b52cc95ac00fac84e726.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/04/9e042586f1d915b0bf5d1b48f963299f/pa/RR70760_9c1eb29f5367b52cc95ac00fac84e726.jpg already downloaded
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F04%252F9e042586f1d915b0bf5d1b48f963299f%252Fpa%252FRR70760_0f9c5b80982fea83612c4820dee4097e.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/04/9e042586f1d915b0bf5d1b48f963299f/pa/RR70760_0f9c5b80982fea83612c4820dee4097e.jpg already downloaded
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F04%252F9e042586f1d915b0bf5d1b48f963299f%252Fpa%252FRR70760_bb7073e050e363484df5acc5f9076d9b.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/04/9e042586f1d915b0bf5d1b48f963299f/pa/RR70760_bb7073e050e363484df5acc5f9076d9b.jpg already downloaded
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F04%252F9e042586f1d915b0bf5d1b48f963299f%252Fpa%252FRR70760_cbfca961c191a0e3401a40c5d7cdc803.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/04/9e042586f1d915b0bf5d1b48f963299f/pa/RR70760_cbfca961c191a0e3401a40c5d7cdc803.jpg already downloaded
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F04%252F9e042586f1d915b0bf5d1b48f963299f%252Fpa%252FRR70760_750b8583f73692674d7311d2eb4c2395.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/04/9e042586f1d915b0bf5d1b48f963299f/pa/RR70760_750b8583f73692674d7311d2eb4c2395.jpg already downloaded
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F04%252F9e042586f1d915b0bf5d1b48f963299f%252Fpa%252FRR70760_c36e74292a4f69f142212570fe5e7f63.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/04/9e042586f1d915b0bf5d1b48f963299f/pa/RR70760_c36e74292a4f69f142212570fe5e7f63.jpg already downloaded
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F04%252F9e042586f1d915b0bf5d1b48f963299f%252Fpa%252FRR70760_bc0a5ac0434362c16fac898ff522e79e.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/04/9e042586f1d915b0bf5d1b48f963299f/pa/RR70760_bc0a5ac0434362c16fac898ff522e79e.jpg already downloaded
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F04%252F9e042586f1d915b0bf5d1b48f963299f%252Fpa%252FRR70760_beaaa390edaa16a94bbe8ca43d3c3487.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/04/9e042586f1d915b0bf5d1b48f963299f/pa/RR70760_beaaa390edaa16a94bbe8ca43d3c3487.jpg already downloaded
2026-03-29 10:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3aa40cf4-1b93-5bba-b866-f8bee9729b02, identifier: RR70760
2026-03-29 10:36:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43e22d51-3b41-5878-9a69-a68611452595 with identifier: HB92022
2026-03-29 10:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43e22d51-3b41-5878-9a69-a68611452595 with scrape type 1
2026-03-29 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 43e22d51-3b41-5878-9a69-a68611452595
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F15%252Ff81516c60f58bd5652b465df60813b7c%252Fpa%252FHB92022_c70e6a9016be8302ea2c3a19d43d3b30.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/15/f81516c60f58bd5652b465df60813b7c/pa/HB92022_c70e6a9016be8302ea2c3a19d43d3b30.jpg already downloaded
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F15%252Ff81516c60f58bd5652b465df60813b7c%252Fpa%252FHB92022_a793856538ca277ea9f1f9b3f4698131.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/15/f81516c60f58bd5652b465df60813b7c/pa/HB92022_a793856538ca277ea9f1f9b3f4698131.jpg already downloaded
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F15%252Ff81516c60f58bd5652b465df60813b7c%252Fpa%252FHB92022_85d4b64333e3731e1f0cfe0fb099ae54.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/15/f81516c60f58bd5652b465df60813b7c/pa/HB92022_85d4b64333e3731e1f0cfe0fb099ae54.jpg already downloaded
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F15%252Ff81516c60f58bd5652b465df60813b7c%252Fpa%252FHB92022_6b047c8e6f1b041f730ed8beae6ad966.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/15/f81516c60f58bd5652b465df60813b7c/pa/HB92022_6b047c8e6f1b041f730ed8beae6ad966.jpg already downloaded
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F15%252Ff81516c60f58bd5652b465df60813b7c%252Fpa%252FHB92022_1399110414643d944b1f14bdc56e2292.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/15/f81516c60f58bd5652b465df60813b7c/pa/HB92022_1399110414643d944b1f14bdc56e2292.jpg already downloaded
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F15%252Ff81516c60f58bd5652b465df60813b7c%252Fpa%252FHB92022_8be6aba6d6334f3984439a49d906f514.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/15/f81516c60f58bd5652b465df60813b7c/pa/HB92022_8be6aba6d6334f3984439a49d906f514.jpg already downloaded
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F15%252Ff81516c60f58bd5652b465df60813b7c%252Fpa%252FHB92022_9b23160d2a5e21e3dc62179248654ce0.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/15/f81516c60f58bd5652b465df60813b7c/pa/HB92022_9b23160d2a5e21e3dc62179248654ce0.jpg already downloaded
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F15%252Ff81516c60f58bd5652b465df60813b7c%252Fpa%252FHB92022_ab46807031685d2ec9b6a88cdd936d75.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/15/f81516c60f58bd5652b465df60813b7c/pa/HB92022_ab46807031685d2ec9b6a88cdd936d75.jpg already downloaded
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F15%252Ff81516c60f58bd5652b465df60813b7c%252Fpa%252FHB92022_6793efa1dc142defef1382a4f2ae84bc.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/15/f81516c60f58bd5652b465df60813b7c/pa/HB92022_6793efa1dc142defef1382a4f2ae84bc.jpg already downloaded
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F15%252Ff81516c60f58bd5652b465df60813b7c%252Fpa%252FHB92022_a895878f6532473c48eaebfbef7ef2e2.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/15/f81516c60f58bd5652b465df60813b7c/pa/HB92022_a895878f6532473c48eaebfbef7ef2e2.jpg already downloaded
2026-03-29 10:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43e22d51-3b41-5878-9a69-a68611452595, identifier: HB92022
2026-03-29 10:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 151649a1-64ec-577d-8c80-9c111bcb75bc with identifier: TB49409
2026-03-29 10:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 151649a1-64ec-577d-8c80-9c111bcb75bc with identifier: TB49409
2026-03-29 10:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 151649a1-64ec-577d-8c80-9c111bcb75bc with identifier: TB49409 to the API
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:31:12Z',
 'fuel_type': 'petrol',
 'id': '151649a1-64ec-577d-8c80-9c111bcb75bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB49409',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 158895,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-08-02',
 'seller_name': None,
 'title': 'Audi A6 1.8',
 'transmission': 'manual',
 'trim': '',
 'year': 2000}
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB49409%27 HTTP/1.1" 200 None
2026-03-29 10:36:34 [auto1.de] INFO: Saving data for TB49409: {'auction_closing_time': 1774884672.0, 'created_time': 1774550710.341582, 'last_price_update_time': 1774780594.705195}
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB49409') HTTP/1.1" 204 0
2026-03-29 10:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ed4827e-63ff-52fd-b656-73d08d805143 with identifier: BS02635
2026-03-29 10:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ed4827e-63ff-52fd-b656-73d08d805143 with identifier: BS02635
2026-03-29 10:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ed4827e-63ff-52fd-b656-73d08d805143 with identifier: BS02635 to the API
2026-03-29 10:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BS02635>
{'auction_title': '',
 'c_o_2_emission_value': 188,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 275,
 'expiration_date': '2026-03-30T15:39:55Z',
 'fuel_type': 'petrol',
 'id': '4ed4827e-63ff-52fd-b656-73d08d805143',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS02635',
 'listing': 'auction',
 'location': 'DE, Hemau',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 49276,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgb5/53/b5535ddafe2ae376338e8facb4473760/pa/BS02635_ca7fc44eb7ca1a4d4dbe40c7a55bc40e.jpg',
                'https://img-pa.auto1.com/imgb5/53/b5535ddafe2ae376338e8facb4473760/pa/BS02635_3b754a5c034bcfdc4e3e311ebfb415b8.jpg',
                'https://img-pa.auto1.com/imgb5/53/b5535ddafe2ae376338e8facb4473760/pa/BS02635_07439fd9ead07b82cf7756c0668bd4ae.jpg',
                'https://img-pa.auto1.com/imgb5/53/b5535ddafe2ae376338e8facb4473760/pa/BS02635_dce73f4549ab5efbf29d29915c3b07ce.jpg',
                'https://img-pa.auto1.com/imgb5/53/b5535ddafe2ae376338e8facb4473760/pa/BS02635_b8654b4b0eb56a9d2eaa8d1a0ceabf95.jpg',
                'https://img-pa.auto1.com/imgb5/53/b5535ddafe2ae376338e8facb4473760/pa/BS02635_1d91e8aad6f673c0e17fc57066f25bf0.jpg',
                'https://img-pa.auto1.com/imgb5/53/b5535ddafe2ae376338e8facb4473760/pa/BS02635_fd917481cba4f0c8b8e73bebdfbdf72f.jpg',
                'https://img-pa.auto1.com/imgb5/53/b5535ddafe2ae376338e8facb4473760/pa/BS02635_2b453a7d317ef2cd776ae054d79ff88d.jpg',
                'https://img-pa.auto1.com/imgb5/53/b5535ddafe2ae376338e8facb4473760/pa/BS02635_35338d4c28c504e368ebd6b7790563ec.jpg',
                'https://img-pa.auto1.com/imgb5/53/b5535ddafe2ae376338e8facb4473760/pa/BS02635_18fb2d032de2b950365fa034b853479e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ed4827e-63ff-52fd-b656-73d08d805143/4ed4827e-63ff-52fd-b656-73d08d805143_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/53/b5535ddafe2ae376338e8facb4473760/pa/BS02635_ca7fc44eb7ca1a4d4dbe40c7a55bc40e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ed4827e-63ff-52fd-b656-73d08d805143/4ed4827e-63ff-52fd-b656-73d08d805143_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/53/b5535ddafe2ae376338e8facb4473760/pa/BS02635_3b754a5c034bcfdc4e3e311ebfb415b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ed4827e-63ff-52fd-b656-73d08d805143/4ed4827e-63ff-52fd-b656-73d08d805143_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/53/b5535ddafe2ae376338e8facb4473760/pa/BS02635_07439fd9ead07b82cf7756c0668bd4ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ed4827e-63ff-52fd-b656-73d08d805143/4ed4827e-63ff-52fd-b656-73d08d805143_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54047,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/53/b5535ddafe2ae376338e8facb4473760/pa/BS02635_dce73f4549ab5efbf29d29915c3b07ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ed4827e-63ff-52fd-b656-73d08d805143/4ed4827e-63ff-52fd-b656-73d08d805143_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/53/b5535ddafe2ae376338e8facb4473760/pa/BS02635_b8654b4b0eb56a9d2eaa8d1a0ceabf95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ed4827e-63ff-52fd-b656-73d08d805143/4ed4827e-63ff-52fd-b656-73d08d805143_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/53/b5535ddafe2ae376338e8facb4473760/pa/BS02635_1d91e8aad6f673c0e17fc57066f25bf0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ed4827e-63ff-52fd-b656-73d08d805143/4ed4827e-63ff-52fd-b656-73d08d805143_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/53/b5535ddafe2ae376338e8facb4473760/pa/BS02635_fd917481cba4f0c8b8e73bebdfbdf72f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ed4827e-63ff-52fd-b656-73d08d805143/4ed4827e-63ff-52fd-b656-73d08d805143_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/53/b5535ddafe2ae376338e8facb4473760/pa/BS02635_2b453a7d317ef2cd776ae054d79ff88d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ed4827e-63ff-52fd-b656-73d08d805143/4ed4827e-63ff-52fd-b656-73d08d805143_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/53/b5535ddafe2ae376338e8facb4473760/pa/BS02635_35338d4c28c504e368ebd6b7790563ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ed4827e-63ff-52fd-b656-73d08d805143/4ed4827e-63ff-52fd-b656-73d08d805143_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/53/b5535ddafe2ae376338e8facb4473760/pa/BS02635_18fb2d032de2b950365fa034b853479e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i30 2.0 TGDI N Performance',
 'transmission': 'manual',
 'trim': 'N Performance',
 'year': 2020}
2026-03-29 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS02635%27 HTTP/1.1" 200 None
2026-03-29 10:36:35 [auto1.de] INFO: Saving data for BS02635: {'created_time': 1774780595.148162, 'last_price_update_time': 1774780595.148175, 'auction_closing_time': 1774885195.0}
2026-03-29 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS02635') HTTP/1.1" 204 0
2026-03-29 10:36:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3aa40cf4-1b93-5bba-b866-f8bee9729b02 with identifier: RR70760
2026-03-29 10:36:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3aa40cf4-1b93-5bba-b866-f8bee9729b02 with identifier: RR70760
2026-03-29 10:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3aa40cf4-1b93-5bba-b866-f8bee9729b02 with identifier: RR70760 to the API
2026-03-29 10:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RR70760>
{'auction_title': '',
 'c_o_2_emission_value': 162,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:16:32Z',
 'fuel_type': 'diesel',
 'id': '3aa40cf4-1b93-5bba-b866-f8bee9729b02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR70760',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 108941,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img9e/04/9e042586f1d915b0bf5d1b48f963299f/pa/RR70760_49b1fdad220b9c704e600794406d605d.jpg',
                'https://img-pa.auto1.com/img9e/04/9e042586f1d915b0bf5d1b48f963299f/pa/RR70760_190d4ed4c766c238ecaed59724275e6c.jpg',
                'https://img-pa.auto1.com/img9e/04/9e042586f1d915b0bf5d1b48f963299f/pa/RR70760_9c1eb29f5367b52cc95ac00fac84e726.jpg',
                'https://img-pa.auto1.com/img9e/04/9e042586f1d915b0bf5d1b48f963299f/pa/RR70760_0f9c5b80982fea83612c4820dee4097e.jpg',
                'https://img-pa.auto1.com/img9e/04/9e042586f1d915b0bf5d1b48f963299f/pa/RR70760_bb7073e050e363484df5acc5f9076d9b.jpg',
                'https://img-pa.auto1.com/img9e/04/9e042586f1d915b0bf5d1b48f963299f/pa/RR70760_cbfca961c191a0e3401a40c5d7cdc803.jpg',
                'https://img-pa.auto1.com/img9e/04/9e042586f1d915b0bf5d1b48f963299f/pa/RR70760_750b8583f73692674d7311d2eb4c2395.jpg',
                'https://img-pa.auto1.com/img9e/04/9e042586f1d915b0bf5d1b48f963299f/pa/RR70760_c36e74292a4f69f142212570fe5e7f63.jpg',
                'https://img-pa.auto1.com/img9e/04/9e042586f1d915b0bf5d1b48f963299f/pa/RR70760_bc0a5ac0434362c16fac898ff522e79e.jpg',
                'https://img-pa.auto1.com/img9e/04/9e042586f1d915b0bf5d1b48f963299f/pa/RR70760_beaaa390edaa16a94bbe8ca43d3c3487.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3aa40cf4-1b93-5bba-b866-f8bee9729b02/3aa40cf4-1b93-5bba-b866-f8bee9729b02_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/04/9e042586f1d915b0bf5d1b48f963299f/pa/RR70760_49b1fdad220b9c704e600794406d605d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3aa40cf4-1b93-5bba-b866-f8bee9729b02/3aa40cf4-1b93-5bba-b866-f8bee9729b02_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78313,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/04/9e042586f1d915b0bf5d1b48f963299f/pa/RR70760_190d4ed4c766c238ecaed59724275e6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3aa40cf4-1b93-5bba-b866-f8bee9729b02/3aa40cf4-1b93-5bba-b866-f8bee9729b02_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/04/9e042586f1d915b0bf5d1b48f963299f/pa/RR70760_9c1eb29f5367b52cc95ac00fac84e726.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3aa40cf4-1b93-5bba-b866-f8bee9729b02/3aa40cf4-1b93-5bba-b866-f8bee9729b02_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/04/9e042586f1d915b0bf5d1b48f963299f/pa/RR70760_0f9c5b80982fea83612c4820dee4097e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3aa40cf4-1b93-5bba-b866-f8bee9729b02/3aa40cf4-1b93-5bba-b866-f8bee9729b02_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65011,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/04/9e042586f1d915b0bf5d1b48f963299f/pa/RR70760_bb7073e050e363484df5acc5f9076d9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3aa40cf4-1b93-5bba-b866-f8bee9729b02/3aa40cf4-1b93-5bba-b866-f8bee9729b02_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/04/9e042586f1d915b0bf5d1b48f963299f/pa/RR70760_cbfca961c191a0e3401a40c5d7cdc803.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3aa40cf4-1b93-5bba-b866-f8bee9729b02/3aa40cf4-1b93-5bba-b866-f8bee9729b02_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/04/9e042586f1d915b0bf5d1b48f963299f/pa/RR70760_750b8583f73692674d7311d2eb4c2395.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3aa40cf4-1b93-5bba-b866-f8bee9729b02/3aa40cf4-1b93-5bba-b866-f8bee9729b02_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/04/9e042586f1d915b0bf5d1b48f963299f/pa/RR70760_c36e74292a4f69f142212570fe5e7f63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3aa40cf4-1b93-5bba-b866-f8bee9729b02/3aa40cf4-1b93-5bba-b866-f8bee9729b02_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/04/9e042586f1d915b0bf5d1b48f963299f/pa/RR70760_bc0a5ac0434362c16fac898ff522e79e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3aa40cf4-1b93-5bba-b866-f8bee9729b02/3aa40cf4-1b93-5bba-b866-f8bee9729b02_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/04/9e042586f1d915b0bf5d1b48f963299f/pa/RR70760_beaaa390edaa16a94bbe8ca43d3c3487.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Jumpy 1.5 Blue-HDi Feel M',
 'transmission': 'manual',
 'trim': 'Feel M',
 'year': 2019}
2026-03-29 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR70760%27 HTTP/1.1" 200 None
2026-03-29 10:36:35 [auto1.de] INFO: Saving data for RR70760: {'created_time': 1774780595.516774, 'last_price_update_time': 1774780595.516786, 'auction_closing_time': 1774883792.0}
2026-03-29 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RR70760') HTTP/1.1" 204 0
2026-03-29 10:36:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43e22d51-3b41-5878-9a69-a68611452595 with identifier: HB92022
2026-03-29 10:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 10:36:35 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-29 10:36:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 10:36:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43e22d51-3b41-5878-9a69-a68611452595 with identifier: HB92022
2026-03-29 10:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43e22d51-3b41-5878-9a69-a68611452595 with identifier: HB92022 to the API
2026-03-29 10:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HB92022>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:05:14Z',
 'fuel_type': 'petrol',
 'id': '43e22d51-3b41-5878-9a69-a68611452595',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB92022',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 64946,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgf8/15/f81516c60f58bd5652b465df60813b7c/pa/HB92022_c70e6a9016be8302ea2c3a19d43d3b30.jpg',
                'https://img-pa.auto1.com/imgf8/15/f81516c60f58bd5652b465df60813b7c/pa/HB92022_a793856538ca277ea9f1f9b3f4698131.jpg',
                'https://img-pa.auto1.com/imgf8/15/f81516c60f58bd5652b465df60813b7c/pa/HB92022_85d4b64333e3731e1f0cfe0fb099ae54.jpg',
                'https://img-pa.auto1.com/imgf8/15/f81516c60f58bd5652b465df60813b7c/pa/HB92022_6b047c8e6f1b041f730ed8beae6ad966.jpg',
                'https://img-pa.auto1.com/imgf8/15/f81516c60f58bd5652b465df60813b7c/pa/HB92022_1399110414643d944b1f14bdc56e2292.jpg',
                'https://img-pa.auto1.com/imgf8/15/f81516c60f58bd5652b465df60813b7c/pa/HB92022_8be6aba6d6334f3984439a49d906f514.jpg',
                'https://img-pa.auto1.com/imgf8/15/f81516c60f58bd5652b465df60813b7c/pa/HB92022_9b23160d2a5e21e3dc62179248654ce0.jpg',
                'https://img-pa.auto1.com/imgf8/15/f81516c60f58bd5652b465df60813b7c/pa/HB92022_ab46807031685d2ec9b6a88cdd936d75.jpg',
                'https://img-pa.auto1.com/imgf8/15/f81516c60f58bd5652b465df60813b7c/pa/HB92022_6793efa1dc142defef1382a4f2ae84bc.jpg',
                'https://img-pa.auto1.com/imgf8/15/f81516c60f58bd5652b465df60813b7c/pa/HB92022_a895878f6532473c48eaebfbef7ef2e2.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43e22d51-3b41-5878-9a69-a68611452595/43e22d51-3b41-5878-9a69-a68611452595_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70271,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/15/f81516c60f58bd5652b465df60813b7c/pa/HB92022_c70e6a9016be8302ea2c3a19d43d3b30.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43e22d51-3b41-5878-9a69-a68611452595/43e22d51-3b41-5878-9a69-a68611452595_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70271,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/15/f81516c60f58bd5652b465df60813b7c/pa/HB92022_a793856538ca277ea9f1f9b3f4698131.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43e22d51-3b41-5878-9a69-a68611452595/43e22d51-3b41-5878-9a69-a68611452595_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/15/f81516c60f58bd5652b465df60813b7c/pa/HB92022_85d4b64333e3731e1f0cfe0fb099ae54.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43e22d51-3b41-5878-9a69-a68611452595/43e22d51-3b41-5878-9a69-a68611452595_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/15/f81516c60f58bd5652b465df60813b7c/pa/HB92022_6b047c8e6f1b041f730ed8beae6ad966.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43e22d51-3b41-5878-9a69-a68611452595/43e22d51-3b41-5878-9a69-a68611452595_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61366,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/15/f81516c60f58bd5652b465df60813b7c/pa/HB92022_1399110414643d944b1f14bdc56e2292.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43e22d51-3b41-5878-9a69-a68611452595/43e22d51-3b41-5878-9a69-a68611452595_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/15/f81516c60f58bd5652b465df60813b7c/pa/HB92022_8be6aba6d6334f3984439a49d906f514.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43e22d51-3b41-5878-9a69-a68611452595/43e22d51-3b41-5878-9a69-a68611452595_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/15/f81516c60f58bd5652b465df60813b7c/pa/HB92022_9b23160d2a5e21e3dc62179248654ce0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43e22d51-3b41-5878-9a69-a68611452595/43e22d51-3b41-5878-9a69-a68611452595_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/15/f81516c60f58bd5652b465df60813b7c/pa/HB92022_ab46807031685d2ec9b6a88cdd936d75.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43e22d51-3b41-5878-9a69-a68611452595/43e22d51-3b41-5878-9a69-a68611452595_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/15/f81516c60f58bd5652b465df60813b7c/pa/HB92022_6793efa1dc142defef1382a4f2ae84bc.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43e22d51-3b41-5878-9a69-a68611452595/43e22d51-3b41-5878-9a69-a68611452595_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/15/f81516c60f58bd5652b465df60813b7c/pa/HB92022_a895878f6532473c48eaebfbef7ef2e2.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Kona 1.0 TGDI Style 2WD',
 'transmission': 'manual',
 'trim': 'Style 2WD',
 'year': 2020}
2026-03-29 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB92022%27 HTTP/1.1" 200 None
2026-03-29 10:36:36 [auto1.de] INFO: Saving data for HB92022: {'created_time': 1774780596.003102, 'last_price_update_time': 1774780596.003114, 'auction_closing_time': 1774883114.0}
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB92022') HTTP/1.1" 204 0
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: NB42822
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB42822%27 HTTP/1.1" 200 None
2026-03-29 10:36:36 [auto1.de] INFO: Scrape type for NB42822: 2
2026-03-29 10:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bf69648-40a0-59f1-af18-d37e306788cd with identifier: NB42822
2026-03-29 10:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bf69648-40a0-59f1-af18-d37e306788cd with scrape type 2
2026-03-29 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1bf69648-40a0-59f1-af18-d37e306788cd with scrape type 2
2026-03-29 10:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1bf69648-40a0-59f1-af18-d37e306788cd, identifier: NB42822
2026-03-29 10:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1bf69648-40a0-59f1-af18-d37e306788cd with identifier: NB42822
2026-03-29 10:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1bf69648-40a0-59f1-af18-d37e306788cd with identifier: NB42822
2026-03-29 10:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1bf69648-40a0-59f1-af18-d37e306788cd with identifier: NB42822 to the API
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:45:05Z',
 'fuel_type': 'diesel',
 'id': '1bf69648-40a0-59f1-af18-d37e306788cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB42822',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Carnival',
 'odometer': 334373,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-13',
 'seller_name': None,
 'title': 'Kia Carnival 2.9 CRDi VGT EX Basis',
 'transmission': 'manual',
 'trim': 'VGT EX Basis',
 'year': 2009}
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB42822%27 HTTP/1.1" 200 None
2026-03-29 10:36:36 [auto1.de] INFO: Saving data for NB42822: {'auction_closing_time': 1774885505.0, 'created_time': 1774550802.765734, 'last_price_update_time': 1774780596.480266}
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB42822') HTTP/1.1" 204 0
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: KU03533
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU03533%27 HTTP/1.1" 200 None
2026-03-29 10:36:36 [auto1.de] INFO: Scrape type for KU03533: 2
2026-03-29 10:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28c0cd65-ff3e-5d50-b06f-d68a254f3481 with identifier: KU03533
2026-03-29 10:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28c0cd65-ff3e-5d50-b06f-d68a254f3481 with scrape type 2
2026-03-29 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28c0cd65-ff3e-5d50-b06f-d68a254f3481 with scrape type 2
2026-03-29 10:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28c0cd65-ff3e-5d50-b06f-d68a254f3481, identifier: KU03533
2026-03-29 10:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28c0cd65-ff3e-5d50-b06f-d68a254f3481 with identifier: KU03533
2026-03-29 10:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28c0cd65-ff3e-5d50-b06f-d68a254f3481 with identifier: KU03533
2026-03-29 10:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28c0cd65-ff3e-5d50-b06f-d68a254f3481 with identifier: KU03533 to the API
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 199,
 'expiration_date': '2026-03-30T15:39:52Z',
 'fuel_type': 'diesel',
 'id': '28c0cd65-ff3e-5d50-b06f-d68a254f3481',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU03533',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Caravelle',
 'odometer': 235223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-04',
 'seller_name': None,
 'title': 'Volkswagen T6 Caravelle 2.0 TDI Comfortline 4Motion',
 'transmission': 'automatic',
 'trim': 'Comfortline 4Motion',
 'year': 2021}
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU03533%27 HTTP/1.1" 200 None
2026-03-29 10:36:36 [auto1.de] INFO: Saving data for KU03533: {'auction_closing_time': 1774885192.0, 'created_time': 1773429425.112844, 'last_price_update_time': 1774780596.977344}
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU03533') HTTP/1.1" 204 0
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: LV79824
2026-03-29 10:36:36 [auto1.de] INFO: Found listing with ID: PM35820
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM35820%27 HTTP/1.1" 200 None
2026-03-29 10:36:37 [auto1.de] INFO: Scrape type for PM35820: 2
2026-03-29 10:36:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e697347-c876-5e32-9eaf-ba59ce799286 with identifier: PM35820
2026-03-29 10:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e697347-c876-5e32-9eaf-ba59ce799286 with scrape type 2
2026-03-29 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e697347-c876-5e32-9eaf-ba59ce799286 with scrape type 2
2026-03-29 10:36:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e697347-c876-5e32-9eaf-ba59ce799286, identifier: PM35820
2026-03-29 10:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e697347-c876-5e32-9eaf-ba59ce799286 with identifier: PM35820
2026-03-29 10:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e697347-c876-5e32-9eaf-ba59ce799286 with identifier: PM35820
2026-03-29 10:36:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e697347-c876-5e32-9eaf-ba59ce799286 with identifier: PM35820 to the API
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:42:26Z',
 'fuel_type': 'petrol',
 'id': '2e697347-c876-5e32-9eaf-ba59ce799286',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM35820',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 168037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-07-28',
 'seller_name': None,
 'title': 'Audi A3 1.8 Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 1999}
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM35820%27 HTTP/1.1" 200 None
2026-03-29 10:36:37 [auto1.de] INFO: Saving data for PM35820: {'auction_closing_time': 1774885346.0, 'created_time': 1773131872.550017, 'last_price_update_time': 1774780597.471835}
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PM35820') HTTP/1.1" 204 0
2026-03-29 10:36:37 [auto1.de] INFO: Found listing with ID: RE71424
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE71424%27 HTTP/1.1" 200 None
2026-03-29 10:36:37 [auto1.de] INFO: Scrape type for RE71424: 2
2026-03-29 10:36:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7897e21e-2c4d-50f4-9351-9413068ec250 with identifier: RE71424
2026-03-29 10:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7897e21e-2c4d-50f4-9351-9413068ec250 with scrape type 2
2026-03-29 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7897e21e-2c4d-50f4-9351-9413068ec250 with scrape type 2
2026-03-29 10:36:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7897e21e-2c4d-50f4-9351-9413068ec250, identifier: RE71424
2026-03-29 10:36:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7897e21e-2c4d-50f4-9351-9413068ec250 with identifier: RE71424
2026-03-29 10:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7897e21e-2c4d-50f4-9351-9413068ec250 with identifier: RE71424
2026-03-29 10:36:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7897e21e-2c4d-50f4-9351-9413068ec250 with identifier: RE71424 to the API
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:31:59Z',
 'fuel_type': 'petrol',
 'id': '7897e21e-2c4d-50f4-9351-9413068ec250',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE71424',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 182581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-01',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 TSI Team',
 'transmission': 'automatic',
 'trim': 'Team',
 'year': 2010}
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE71424%27 HTTP/1.1" 200 None
2026-03-29 10:36:37 [auto1.de] INFO: Saving data for RE71424: {'auction_closing_time': 1774884719.0, 'created_time': 1774034918.918706, 'last_price_update_time': 1774780597.950706}
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE71424') HTTP/1.1" 204 0
2026-03-29 10:36:37 [auto1.de] INFO: Found listing with ID: TZ64186
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ64186%27 HTTP/1.1" 200 None
2026-03-29 10:36:37 [auto1.de] INFO: Scrape type for TZ64186: 2
2026-03-29 10:36:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcdb418c-6e0d-50f3-8237-8df643b09a01 with identifier: TZ64186
2026-03-29 10:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcdb418c-6e0d-50f3-8237-8df643b09a01 with scrape type 2
2026-03-29 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcdb418c-6e0d-50f3-8237-8df643b09a01 with scrape type 2
2026-03-29 10:36:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fcdb418c-6e0d-50f3-8237-8df643b09a01, identifier: TZ64186
2026-03-29 10:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MH98673/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XG25622> (referer: https://www.auto1.com/v1/car-details-view/XG25622/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fcdb418c-6e0d-50f3-8237-8df643b09a01 with identifier: TZ64186
2026-03-29 10:36:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fcdb418c-6e0d-50f3-8237-8df643b09a01 with identifier: TZ64186
2026-03-29 10:36:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fcdb418c-6e0d-50f3-8237-8df643b09a01 with identifier: TZ64186 to the API
2026-03-29 10:36:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-30T15:43:05Z',
 'fuel_type': 'diesel',
 'id': 'fcdb418c-6e0d-50f3-8237-8df643b09a01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ64186',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 183743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-07',
 'seller_name': None,
 'title': 'Audi A6 45 TDI Mild-Hybrid quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2018}
2026-03-29 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ64186%27 HTTP/1.1" 200 None
2026-03-29 10:36:38 [auto1.de] INFO: Saving data for TZ64186: {'auction_closing_time': 1774885385.0, 'created_time': 1774379158.155571, 'last_price_update_time': 1774780598.452597}
2026-03-29 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TZ64186') HTTP/1.1" 204 0
2026-03-29 10:36:38 [auto1.de] INFO: Found listing with ID: HE78253
2026-03-29 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE78253%27 HTTP/1.1" 200 None
2026-03-29 10:36:38 [auto1.de] INFO: Scrape type for HE78253: 2
2026-03-29 10:36:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e35f40a6-8e9c-5ba0-908b-12af256a9ed0 with identifier: HE78253
2026-03-29 10:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e35f40a6-8e9c-5ba0-908b-12af256a9ed0 with scrape type 2
2026-03-29 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e35f40a6-8e9c-5ba0-908b-12af256a9ed0 with scrape type 2
2026-03-29 10:36:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e35f40a6-8e9c-5ba0-908b-12af256a9ed0, identifier: HE78253
2026-03-29 10:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e35f40a6-8e9c-5ba0-908b-12af256a9ed0 with identifier: HE78253
2026-03-29 10:36:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e35f40a6-8e9c-5ba0-908b-12af256a9ed0 with identifier: HE78253
2026-03-29 10:36:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e35f40a6-8e9c-5ba0-908b-12af256a9ed0 with identifier: HE78253 to the API
2026-03-29 10:36:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:40:26Z',
 'fuel_type': 'petrol',
 'id': 'e35f40a6-8e9c-5ba0-908b-12af256a9ed0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE78253',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 137014,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-12-31',
 'seller_name': None,
 'title': 'Skoda Fabia 2.0 Extra',
 'transmission': 'manual',
 'trim': 'Extra',
 'year': 2003}
2026-03-29 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE78253%27 HTTP/1.1" 200 None
2026-03-29 10:36:38 [auto1.de] INFO: Saving data for HE78253: {'auction_closing_time': 1774885226.0, 'created_time': 1774550903.524119, 'last_price_update_time': 1774780598.911399}
2026-03-29 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE78253') HTTP/1.1" 204 0
2026-03-29 10:36:38 [auto1.de] INFO: Found listing with ID: WC37981
2026-03-29 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC37981%27 HTTP/1.1" 200 None
2026-03-29 10:36:38 [auto1.de] INFO: Scrape type for WC37981: 2
2026-03-29 10:36:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 337c3b48-1e0b-5d50-baa6-5bca177efb8d with identifier: WC37981
2026-03-29 10:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 337c3b48-1e0b-5d50-baa6-5bca177efb8d with scrape type 2
2026-03-29 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 337c3b48-1e0b-5d50-baa6-5bca177efb8d with scrape type 2
2026-03-29 10:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 337c3b48-1e0b-5d50-baa6-5bca177efb8d, identifier: WC37981
2026-03-29 10:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZJ67042> (referer: https://www.auto1.com/v1/car-details-view/ZJ67042/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 337c3b48-1e0b-5d50-baa6-5bca177efb8d with identifier: WC37981
2026-03-29 10:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 337c3b48-1e0b-5d50-baa6-5bca177efb8d with identifier: WC37981
2026-03-29 10:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 337c3b48-1e0b-5d50-baa6-5bca177efb8d with identifier: WC37981 to the API
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:56:04Z',
 'fuel_type': 'diesel',
 'id': '337c3b48-1e0b-5d50-baa6-5bca177efb8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC37981',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 260590,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-16',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI RS',
 'transmission': 'automatic',
 'trim': 'RS',
 'year': 2012}
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC37981%27 HTTP/1.1" 200 None
2026-03-29 10:36:39 [auto1.de] INFO: Saving data for WC37981: {'auction_closing_time': 1774886164.0, 'created_time': 1773571597.949573, 'last_price_update_time': 1774780599.387723}
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC37981') HTTP/1.1" 204 0
2026-03-29 10:36:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85c4481a-5599-53a9-b681-cfd3ebaeba54 with identifier: XG25622
2026-03-29 10:36:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85c4481a-5599-53a9-b681-cfd3ebaeba54 with scrape type 1
2026-03-29 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 85c4481a-5599-53a9-b681-cfd3ebaeba54
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F0e%252F410eb80086f96b37aec45c695e69754d%252Fpa%252FXG25622_2f5d9e77666d6cf96e27606ce34eab94.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/0e/410eb80086f96b37aec45c695e69754d/pa/XG25622_2f5d9e77666d6cf96e27606ce34eab94.jpg already downloaded
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F0e%252F410eb80086f96b37aec45c695e69754d%252Fpa%252FXG25622_9117e1792f21d1d1f48ca84b087dbdfe.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/0e/410eb80086f96b37aec45c695e69754d/pa/XG25622_9117e1792f21d1d1f48ca84b087dbdfe.jpg already downloaded
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F0e%252F410eb80086f96b37aec45c695e69754d%252Fpa%252FXG25622_bf4ee04f57a194185602dfef370a4096.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/0e/410eb80086f96b37aec45c695e69754d/pa/XG25622_bf4ee04f57a194185602dfef370a4096.jpg already downloaded
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F0e%252F410eb80086f96b37aec45c695e69754d%252Fpa%252FXG25622_6b5a0cbf677c61fabb89c94b5cf326f5.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/0e/410eb80086f96b37aec45c695e69754d/pa/XG25622_6b5a0cbf677c61fabb89c94b5cf326f5.jpg already downloaded
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F0e%252F410eb80086f96b37aec45c695e69754d%252Fpa%252FXG25622_676f38b0901916ec2bb42cd7ecb95998.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/0e/410eb80086f96b37aec45c695e69754d/pa/XG25622_676f38b0901916ec2bb42cd7ecb95998.jpg already downloaded
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F0e%252F410eb80086f96b37aec45c695e69754d%252Fpa%252FXG25622_6ebbb8150b2738b979e541cc14870cf5.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/0e/410eb80086f96b37aec45c695e69754d/pa/XG25622_6ebbb8150b2738b979e541cc14870cf5.jpg already downloaded
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F0e%252F410eb80086f96b37aec45c695e69754d%252Fpa%252FXG25622_754989b1fd92bb2585794977951a4b96.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/0e/410eb80086f96b37aec45c695e69754d/pa/XG25622_754989b1fd92bb2585794977951a4b96.jpg already downloaded
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F0e%252F410eb80086f96b37aec45c695e69754d%252Fpa%252FXG25622_e74576c09f046519d66b686629383131.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/0e/410eb80086f96b37aec45c695e69754d/pa/XG25622_e74576c09f046519d66b686629383131.jpg already downloaded
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F0e%252F410eb80086f96b37aec45c695e69754d%252Fpa%252FXG25622_fde0c3fb6d7f0e160e50242f301b38f3.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/0e/410eb80086f96b37aec45c695e69754d/pa/XG25622_fde0c3fb6d7f0e160e50242f301b38f3.jpg already downloaded
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F0e%252F410eb80086f96b37aec45c695e69754d%252Fpa%252FXG25622_fe62d964721886da5168cef4eae7c5ff.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/0e/410eb80086f96b37aec45c695e69754d/pa/XG25622_fe62d964721886da5168cef4eae7c5ff.jpg already downloaded
2026-03-29 10:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85c4481a-5599-53a9-b681-cfd3ebaeba54, identifier: XG25622
2026-03-29 10:36:39 [auto1.de] INFO: Found listing with ID: VU91193
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU91193%27 HTTP/1.1" 200 None
2026-03-29 10:36:39 [auto1.de] INFO: Scrape type for VU91193: 2
2026-03-29 10:36:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63224ded-4d7a-5829-bb28-142bd96caf78 with identifier: VU91193
2026-03-29 10:36:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63224ded-4d7a-5829-bb28-142bd96caf78 with scrape type 2
2026-03-29 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63224ded-4d7a-5829-bb28-142bd96caf78 with scrape type 2
2026-03-29 10:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63224ded-4d7a-5829-bb28-142bd96caf78, identifier: VU91193
2026-03-29 10:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85c4481a-5599-53a9-b681-cfd3ebaeba54 with identifier: XG25622
2026-03-29 10:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85c4481a-5599-53a9-b681-cfd3ebaeba54 with identifier: XG25622
2026-03-29 10:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85c4481a-5599-53a9-b681-cfd3ebaeba54 with identifier: XG25622 to the API
2026-03-29 10:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XG25622>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:05:56Z',
 'fuel_type': 'hybrid',
 'id': '85c4481a-5599-53a9-b681-cfd3ebaeba54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG25622',
 'listing': 'auction',
 'location': 'DE, Zülpich',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 1756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img41/0e/410eb80086f96b37aec45c695e69754d/pa/XG25622_2f5d9e77666d6cf96e27606ce34eab94.jpg',
                'https://img-pa.auto1.com/img41/0e/410eb80086f96b37aec45c695e69754d/pa/XG25622_9117e1792f21d1d1f48ca84b087dbdfe.jpg',
                'https://img-pa.auto1.com/img41/0e/410eb80086f96b37aec45c695e69754d/pa/XG25622_bf4ee04f57a194185602dfef370a4096.jpg',
                'https://img-pa.auto1.com/img41/0e/410eb80086f96b37aec45c695e69754d/pa/XG25622_6b5a0cbf677c61fabb89c94b5cf326f5.jpg',
                'https://img-pa.auto1.com/img41/0e/410eb80086f96b37aec45c695e69754d/pa/XG25622_676f38b0901916ec2bb42cd7ecb95998.jpg',
                'https://img-pa.auto1.com/img41/0e/410eb80086f96b37aec45c695e69754d/pa/XG25622_6ebbb8150b2738b979e541cc14870cf5.jpg',
                'https://img-pa.auto1.com/img41/0e/410eb80086f96b37aec45c695e69754d/pa/XG25622_754989b1fd92bb2585794977951a4b96.jpg',
                'https://img-pa.auto1.com/img41/0e/410eb80086f96b37aec45c695e69754d/pa/XG25622_e74576c09f046519d66b686629383131.jpg',
                'https://img-pa.auto1.com/img41/0e/410eb80086f96b37aec45c695e69754d/pa/XG25622_fde0c3fb6d7f0e160e50242f301b38f3.jpg',
                'https://img-pa.auto1.com/img41/0e/410eb80086f96b37aec45c695e69754d/pa/XG25622_fe62d964721886da5168cef4eae7c5ff.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85c4481a-5599-53a9-b681-cfd3ebaeba54/85c4481a-5599-53a9-b681-cfd3ebaeba54_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93581,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/0e/410eb80086f96b37aec45c695e69754d/pa/XG25622_2f5d9e77666d6cf96e27606ce34eab94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85c4481a-5599-53a9-b681-cfd3ebaeba54/85c4481a-5599-53a9-b681-cfd3ebaeba54_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80017,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/0e/410eb80086f96b37aec45c695e69754d/pa/XG25622_9117e1792f21d1d1f48ca84b087dbdfe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85c4481a-5599-53a9-b681-cfd3ebaeba54/85c4481a-5599-53a9-b681-cfd3ebaeba54_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76479,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/0e/410eb80086f96b37aec45c695e69754d/pa/XG25622_bf4ee04f57a194185602dfef370a4096.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85c4481a-5599-53a9-b681-cfd3ebaeba54/85c4481a-5599-53a9-b681-cfd3ebaeba54_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62007,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/0e/410eb80086f96b37aec45c695e69754d/pa/XG25622_6b5a0cbf677c61fabb89c94b5cf326f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85c4481a-5599-53a9-b681-cfd3ebaeba54/85c4481a-5599-53a9-b681-cfd3ebaeba54_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64091,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/0e/410eb80086f96b37aec45c695e69754d/pa/XG25622_676f38b0901916ec2bb42cd7ecb95998.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85c4481a-5599-53a9-b681-cfd3ebaeba54/85c4481a-5599-53a9-b681-cfd3ebaeba54_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70766,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/0e/410eb80086f96b37aec45c695e69754d/pa/XG25622_6ebbb8150b2738b979e541cc14870cf5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85c4481a-5599-53a9-b681-cfd3ebaeba54/85c4481a-5599-53a9-b681-cfd3ebaeba54_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/0e/410eb80086f96b37aec45c695e69754d/pa/XG25622_754989b1fd92bb2585794977951a4b96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85c4481a-5599-53a9-b681-cfd3ebaeba54/85c4481a-5599-53a9-b681-cfd3ebaeba54_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/0e/410eb80086f96b37aec45c695e69754d/pa/XG25622_e74576c09f046519d66b686629383131.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85c4481a-5599-53a9-b681-cfd3ebaeba54/85c4481a-5599-53a9-b681-cfd3ebaeba54_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87264,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/0e/410eb80086f96b37aec45c695e69754d/pa/XG25622_fde0c3fb6d7f0e160e50242f301b38f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_85c4481a-5599-53a9-b681-cfd3ebaeba54/85c4481a-5599-53a9-b681-cfd3ebaeba54_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/0e/410eb80086f96b37aec45c695e69754d/pa/XG25622_fe62d964721886da5168cef4eae7c5ff.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-05-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki Vitara 1.5 Dualjet Hybrid Comfort 4x2',
 'transmission': 'automatic',
 'trim': 'Comfort 4x2',
 'year': 2025}
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG25622%27 HTTP/1.1" 200 None
2026-03-29 10:36:40 [auto1.de] INFO: Saving data for XG25622: {'created_time': 1774780600.128635, 'last_price_update_time': 1774780600.128647, 'auction_closing_time': 1774883156.0}
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XG25622') HTTP/1.1" 204 0
2026-03-29 10:36:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63224ded-4d7a-5829-bb28-142bd96caf78 with identifier: VU91193
2026-03-29 10:36:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63224ded-4d7a-5829-bb28-142bd96caf78 with identifier: VU91193
2026-03-29 10:36:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63224ded-4d7a-5829-bb28-142bd96caf78 with identifier: VU91193 to the API
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:11:19Z',
 'fuel_type': 'diesel',
 'id': '63224ded-4d7a-5829-bb28-142bd96caf78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU91193',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 215458,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-07-10',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CDI T Classic',
 'transmission': 'automatic',
 'trim': 'T Classic',
 'year': 2002}
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU91193%27 HTTP/1.1" 200 None
2026-03-29 10:36:40 [auto1.de] INFO: Saving data for VU91193: {'auction_closing_time': 1774883479.0, 'created_time': 1773380917.728227, 'last_price_update_time': 1774780600.501586}
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VU91193') HTTP/1.1" 204 0
2026-03-29 10:36:40 [auto1.de] INFO: Channel: 24h | Page: 8 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: TX49680
2026-03-29 10:36:40 [auto1.de] INFO: Found listing with ID: HA87343
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA87343%27 HTTP/1.1" 200 None
2026-03-29 10:36:40 [auto1.de] INFO: Scrape type for HA87343: 2
2026-03-29 10:36:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90099c28-5e98-5149-b0e6-bbd65e8daec1 with identifier: HA87343
2026-03-29 10:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90099c28-5e98-5149-b0e6-bbd65e8daec1 with scrape type 2
2026-03-29 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90099c28-5e98-5149-b0e6-bbd65e8daec1 with scrape type 2
2026-03-29 10:36:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90099c28-5e98-5149-b0e6-bbd65e8daec1, identifier: HA87343
2026-03-29 10:36:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90099c28-5e98-5149-b0e6-bbd65e8daec1 with identifier: HA87343
2026-03-29 10:36:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90099c28-5e98-5149-b0e6-bbd65e8daec1 with identifier: HA87343
2026-03-29 10:36:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90099c28-5e98-5149-b0e6-bbd65e8daec1 with identifier: HA87343 to the API
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:42:39Z',
 'fuel_type': 'petrol',
 'id': '90099c28-5e98-5149-b0e6-bbd65e8daec1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA87343',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 211061,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-08-04',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2005}
2026-03-29 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA87343%27 HTTP/1.1" 200 None
2026-03-29 10:36:41 [auto1.de] INFO: Saving data for HA87343: {'auction_closing_time': 1774885359.0, 'created_time': 1773429290.911001, 'last_price_update_time': 1774780601.109346}
2026-03-29 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA87343') HTTP/1.1" 204 0
2026-03-29 10:36:41 [auto1.de] INFO: Found listing with ID: KF75867
2026-03-29 10:36:41 [auto1.de] INFO: Found listing with ID: JA01983
2026-03-29 10:36:41 [auto1.de] INFO: Found listing with ID: UJ23150
2026-03-29 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ23150%27 HTTP/1.1" 200 None
2026-03-29 10:36:41 [auto1.de] INFO: Scrape type for UJ23150: 1
2026-03-29 10:36:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb7085cb-65c5-5546-9916-9d777e6eb8ec with identifier: ZJ67042
2026-03-29 10:36:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb7085cb-65c5-5546-9916-9d777e6eb8ec with scrape type 1
2026-03-29 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bb7085cb-65c5-5546-9916-9d777e6eb8ec
2026-03-29 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F93%252Fe393c0a2664ec5cd51372a7e99567566%252Fpa%252FZJ67042_0ff3205239253648fe65757f3f77c087.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/93/e393c0a2664ec5cd51372a7e99567566/pa/ZJ67042_0ff3205239253648fe65757f3f77c087.jpg already downloaded
2026-03-29 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F93%252Fe393c0a2664ec5cd51372a7e99567566%252Fpa%252FZJ67042_cfdadf7533e6535d589436da63afbc33.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/93/e393c0a2664ec5cd51372a7e99567566/pa/ZJ67042_cfdadf7533e6535d589436da63afbc33.jpg already downloaded
2026-03-29 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F93%252Fe393c0a2664ec5cd51372a7e99567566%252Fpa%252FZJ67042_d6d34686ca5a7b70267f32460fae2c7e.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/93/e393c0a2664ec5cd51372a7e99567566/pa/ZJ67042_d6d34686ca5a7b70267f32460fae2c7e.jpg already downloaded
2026-03-29 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F93%252Fe393c0a2664ec5cd51372a7e99567566%252Fpa%252FZJ67042_de369d821e5131eb702f4d6fa314a71f.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/93/e393c0a2664ec5cd51372a7e99567566/pa/ZJ67042_de369d821e5131eb702f4d6fa314a71f.jpg already downloaded
2026-03-29 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F93%252Fe393c0a2664ec5cd51372a7e99567566%252Fpa%252FZJ67042_d6a4973be23637df914b4d248631e859.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/93/e393c0a2664ec5cd51372a7e99567566/pa/ZJ67042_d6a4973be23637df914b4d248631e859.jpg already downloaded
2026-03-29 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F93%252Fe393c0a2664ec5cd51372a7e99567566%252Fpa%252FZJ67042_5c944732032738b8138b125445e70edf.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/93/e393c0a2664ec5cd51372a7e99567566/pa/ZJ67042_5c944732032738b8138b125445e70edf.jpg already downloaded
2026-03-29 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F93%252Fe393c0a2664ec5cd51372a7e99567566%252Fpa%252FZJ67042_39b38d3e742980e8eafe03d3153f21a2.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/93/e393c0a2664ec5cd51372a7e99567566/pa/ZJ67042_39b38d3e742980e8eafe03d3153f21a2.jpg already downloaded
2026-03-29 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F93%252Fe393c0a2664ec5cd51372a7e99567566%252Fpa%252FZJ67042_9eeaee187b79389770e6a83145f4ba4c.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/93/e393c0a2664ec5cd51372a7e99567566/pa/ZJ67042_9eeaee187b79389770e6a83145f4ba4c.jpg already downloaded
2026-03-29 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F93%252Fe393c0a2664ec5cd51372a7e99567566%252Fpa%252FZJ67042_21301629a080550063e19aca24969648.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/93/e393c0a2664ec5cd51372a7e99567566/pa/ZJ67042_21301629a080550063e19aca24969648.jpg already downloaded
2026-03-29 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F93%252Fe393c0a2664ec5cd51372a7e99567566%252Fpa%252FZJ67042_53dad16069c19257e618ad3a0dcde45b.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/93/e393c0a2664ec5cd51372a7e99567566/pa/ZJ67042_53dad16069c19257e618ad3a0dcde45b.jpg already downloaded
2026-03-29 10:36:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb7085cb-65c5-5546-9916-9d777e6eb8ec, identifier: ZJ67042
2026-03-29 10:36:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:41 [auto1.de] INFO: Found listing with ID: EE57065
2026-03-29 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE57065%27 HTTP/1.1" 200 None
2026-03-29 10:36:41 [auto1.de] INFO: Scrape type for EE57065: 2
2026-03-29 10:36:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f841a43-da93-57a7-ac42-7157fc54b570 with identifier: EE57065
2026-03-29 10:36:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f841a43-da93-57a7-ac42-7157fc54b570 with scrape type 2
2026-03-29 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f841a43-da93-57a7-ac42-7157fc54b570 with scrape type 2
2026-03-29 10:36:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f841a43-da93-57a7-ac42-7157fc54b570, identifier: EE57065
2026-03-29 10:36:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb7085cb-65c5-5546-9916-9d777e6eb8ec with identifier: ZJ67042
2026-03-29 10:36:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb7085cb-65c5-5546-9916-9d777e6eb8ec with identifier: ZJ67042
2026-03-29 10:36:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb7085cb-65c5-5546-9916-9d777e6eb8ec with identifier: ZJ67042 to the API
2026-03-29 10:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZJ67042>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:18:07Z',
 'fuel_type': 'diesel',
 'id': 'bb7085cb-65c5-5546-9916-9d777e6eb8ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ67042',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'Mercedes-Benz',
 'model': 'GLB-Klasse',
 'odometer': 85679,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge3/93/e393c0a2664ec5cd51372a7e99567566/pa/ZJ67042_0ff3205239253648fe65757f3f77c087.jpg',
                'https://img-pa.auto1.com/imge3/93/e393c0a2664ec5cd51372a7e99567566/pa/ZJ67042_cfdadf7533e6535d589436da63afbc33.jpg',
                'https://img-pa.auto1.com/imge3/93/e393c0a2664ec5cd51372a7e99567566/pa/ZJ67042_d6d34686ca5a7b70267f32460fae2c7e.jpg',
                'https://img-pa.auto1.com/imge3/93/e393c0a2664ec5cd51372a7e99567566/pa/ZJ67042_de369d821e5131eb702f4d6fa314a71f.jpg',
                'https://img-pa.auto1.com/imge3/93/e393c0a2664ec5cd51372a7e99567566/pa/ZJ67042_d6a4973be23637df914b4d248631e859.jpg',
                'https://img-pa.auto1.com/imge3/93/e393c0a2664ec5cd51372a7e99567566/pa/ZJ67042_5c944732032738b8138b125445e70edf.jpg',
                'https://img-pa.auto1.com/imge3/93/e393c0a2664ec5cd51372a7e99567566/pa/ZJ67042_39b38d3e742980e8eafe03d3153f21a2.jpg',
                'https://img-pa.auto1.com/imge3/93/e393c0a2664ec5cd51372a7e99567566/pa/ZJ67042_9eeaee187b79389770e6a83145f4ba4c.jpg',
                'https://img-pa.auto1.com/imge3/93/e393c0a2664ec5cd51372a7e99567566/pa/ZJ67042_21301629a080550063e19aca24969648.jpg',
                'https://img-pa.auto1.com/imge3/93/e393c0a2664ec5cd51372a7e99567566/pa/ZJ67042_53dad16069c19257e618ad3a0dcde45b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb7085cb-65c5-5546-9916-9d777e6eb8ec/bb7085cb-65c5-5546-9916-9d777e6eb8ec_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/93/e393c0a2664ec5cd51372a7e99567566/pa/ZJ67042_0ff3205239253648fe65757f3f77c087.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb7085cb-65c5-5546-9916-9d777e6eb8ec/bb7085cb-65c5-5546-9916-9d777e6eb8ec_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/93/e393c0a2664ec5cd51372a7e99567566/pa/ZJ67042_cfdadf7533e6535d589436da63afbc33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb7085cb-65c5-5546-9916-9d777e6eb8ec/bb7085cb-65c5-5546-9916-9d777e6eb8ec_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/93/e393c0a2664ec5cd51372a7e99567566/pa/ZJ67042_d6d34686ca5a7b70267f32460fae2c7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb7085cb-65c5-5546-9916-9d777e6eb8ec/bb7085cb-65c5-5546-9916-9d777e6eb8ec_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/93/e393c0a2664ec5cd51372a7e99567566/pa/ZJ67042_de369d821e5131eb702f4d6fa314a71f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb7085cb-65c5-5546-9916-9d777e6eb8ec/bb7085cb-65c5-5546-9916-9d777e6eb8ec_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/93/e393c0a2664ec5cd51372a7e99567566/pa/ZJ67042_d6a4973be23637df914b4d248631e859.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb7085cb-65c5-5546-9916-9d777e6eb8ec/bb7085cb-65c5-5546-9916-9d777e6eb8ec_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/93/e393c0a2664ec5cd51372a7e99567566/pa/ZJ67042_5c944732032738b8138b125445e70edf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb7085cb-65c5-5546-9916-9d777e6eb8ec/bb7085cb-65c5-5546-9916-9d777e6eb8ec_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/93/e393c0a2664ec5cd51372a7e99567566/pa/ZJ67042_39b38d3e742980e8eafe03d3153f21a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb7085cb-65c5-5546-9916-9d777e6eb8ec/bb7085cb-65c5-5546-9916-9d777e6eb8ec_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/93/e393c0a2664ec5cd51372a7e99567566/pa/ZJ67042_9eeaee187b79389770e6a83145f4ba4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb7085cb-65c5-5546-9916-9d777e6eb8ec/bb7085cb-65c5-5546-9916-9d777e6eb8ec_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/93/e393c0a2664ec5cd51372a7e99567566/pa/ZJ67042_21301629a080550063e19aca24969648.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb7085cb-65c5-5546-9916-9d777e6eb8ec/bb7085cb-65c5-5546-9916-9d777e6eb8ec_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91014,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/93/e393c0a2664ec5cd51372a7e99567566/pa/ZJ67042_53dad16069c19257e618ad3a0dcde45b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLB-Klasse GLB 220 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2021}
2026-03-29 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ67042%27 HTTP/1.1" 200 None
2026-03-29 10:36:42 [auto1.de] INFO: Saving data for ZJ67042: {'created_time': 1774780602.178401, 'last_price_update_time': 1774780602.178415, 'auction_closing_time': 1774883887.0}
2026-03-29 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ67042') HTTP/1.1" 204 0
2026-03-29 10:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f841a43-da93-57a7-ac42-7157fc54b570 with identifier: EE57065
2026-03-29 10:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f841a43-da93-57a7-ac42-7157fc54b570 with identifier: EE57065
2026-03-29 10:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f841a43-da93-57a7-ac42-7157fc54b570 with identifier: EE57065 to the API
2026-03-29 10:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:26:41Z',
 'fuel_type': 'diesel',
 'id': '2f841a43-da93-57a7-ac42-7157fc54b570',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE57065',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 149669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-31',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 310 L2 Tourneo Titanium',
 'transmission': 'automatic',
 'trim': '310 L2 Tourneo Titanium',
 'year': 2018}
2026-03-29 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE57065%27 HTTP/1.1" 200 None
2026-03-29 10:36:42 [auto1.de] INFO: Saving data for EE57065: {'auction_closing_time': 1774884401.0, 'created_time': 1773658464.206997, 'last_price_update_time': 1774780602.62164}
2026-03-29 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE57065') HTTP/1.1" 204 0
2026-03-29 10:36:42 [auto1.de] INFO: Found listing with ID: AH44309
2026-03-29 10:36:42 [auto1.de] INFO: Found listing with ID: PM99817
2026-03-29 10:36:42 [auto1.de] INFO: Found listing with ID: YK45245
2026-03-29 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK45245%27 HTTP/1.1" 200 None
2026-03-29 10:36:42 [auto1.de] INFO: Scrape type for YK45245: 1
2026-03-29 10:36:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:42 [auto1.de] INFO: Found listing with ID: BP97760
2026-03-29 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP97760%27 HTTP/1.1" 200 None
2026-03-29 10:36:42 [auto1.de] INFO: Scrape type for BP97760: 2
2026-03-29 10:36:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7a10aff-3210-5c74-937b-2cabc861e759 with identifier: BP97760
2026-03-29 10:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7a10aff-3210-5c74-937b-2cabc861e759 with scrape type 2
2026-03-29 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7a10aff-3210-5c74-937b-2cabc861e759 with scrape type 2
2026-03-29 10:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7a10aff-3210-5c74-937b-2cabc861e759, identifier: BP97760
2026-03-29 10:36:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GT54138> (referer: https://www.auto1.com/v1/car-details-view/GT54138/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7a10aff-3210-5c74-937b-2cabc861e759 with identifier: BP97760
2026-03-29 10:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7a10aff-3210-5c74-937b-2cabc861e759 with identifier: BP97760
2026-03-29 10:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7a10aff-3210-5c74-937b-2cabc861e759 with identifier: BP97760 to the API
2026-03-29 10:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:04:25Z',
 'fuel_type': 'diesel',
 'id': 'a7a10aff-3210-5c74-937b-2cabc861e759',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP97760',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 294106,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-28',
 'seller_name': None,
 'title': 'Renault Twingo 1.5 dCi Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2011}
2026-03-29 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP97760%27 HTTP/1.1" 200 None
2026-03-29 10:36:43 [auto1.de] INFO: Saving data for BP97760: {'auction_closing_time': 1774883065.0, 'created_time': 1774550809.854508, 'last_price_update_time': 1774780603.302897}
2026-03-29 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP97760') HTTP/1.1" 204 0
2026-03-29 10:36:43 [auto1.de] INFO: Found listing with ID: DB08314
2026-03-29 10:36:43 [auto1.de] INFO: Found listing with ID: HS17931
2026-03-29 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS17931%27 HTTP/1.1" 200 None
2026-03-29 10:36:43 [auto1.de] INFO: Scrape type for HS17931: 2
2026-03-29 10:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 596af2bf-2067-5ea8-9de2-f04900fbe034 with identifier: HS17931
2026-03-29 10:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 596af2bf-2067-5ea8-9de2-f04900fbe034 with scrape type 2
2026-03-29 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 596af2bf-2067-5ea8-9de2-f04900fbe034 with scrape type 2
2026-03-29 10:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 596af2bf-2067-5ea8-9de2-f04900fbe034, identifier: HS17931
2026-03-29 10:36:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:43 [auto1.de] INFO: Found listing with ID: MW79047
2026-03-29 10:36:43 [auto1.de] INFO: Found listing with ID: RP29277
2026-03-29 10:36:43 [auto1.de] INFO: Found listing with ID: HC04393
2026-03-29 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC04393%27 HTTP/1.1" 200 None
2026-03-29 10:36:43 [auto1.de] INFO: Scrape type for HC04393: 2
2026-03-29 10:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80c0b54b-da13-541f-a170-f6c4b67c479a with identifier: HC04393
2026-03-29 10:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80c0b54b-da13-541f-a170-f6c4b67c479a with scrape type 2
2026-03-29 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80c0b54b-da13-541f-a170-f6c4b67c479a with scrape type 2
2026-03-29 10:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80c0b54b-da13-541f-a170-f6c4b67c479a, identifier: HC04393
2026-03-29 10:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 596af2bf-2067-5ea8-9de2-f04900fbe034 with identifier: HS17931
2026-03-29 10:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 596af2bf-2067-5ea8-9de2-f04900fbe034 with identifier: HS17931
2026-03-29 10:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 596af2bf-2067-5ea8-9de2-f04900fbe034 with identifier: HS17931 to the API
2026-03-29 10:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:30:56Z',
 'fuel_type': 'petrol',
 'id': '596af2bf-2067-5ea8-9de2-f04900fbe034',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS17931',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 152281,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-10-11',
 'seller_name': None,
 'title': 'Volvo V40 1.8',
 'transmission': 'manual',
 'trim': '',
 'year': 1998}
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS17931%27 HTTP/1.1" 200 None
2026-03-29 10:36:44 [auto1.de] INFO: Saving data for HS17931: {'auction_closing_time': 1774884656.0, 'created_time': 1773427388.07274, 'last_price_update_time': 1774780604.922502}
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HS17931') HTTP/1.1" 204 0
2026-03-29 10:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80c0b54b-da13-541f-a170-f6c4b67c479a with identifier: HC04393
2026-03-29 10:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80c0b54b-da13-541f-a170-f6c4b67c479a with identifier: HC04393
2026-03-29 10:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80c0b54b-da13-541f-a170-f6c4b67c479a with identifier: HC04393 to the API
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:47:25Z',
 'fuel_type': 'petrol',
 'id': '80c0b54b-da13-541f-a170-f6c4b67c479a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC04393',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 237954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-05',
 'seller_name': None,
 'title': 'Hyundai ix35 2.0 Premium 2WD',
 'transmission': 'manual',
 'trim': 'Premium 2WD',
 'year': 2014}
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC04393%27 HTTP/1.1" 200 None
2026-03-29 10:36:45 [auto1.de] INFO: Saving data for HC04393: {'auction_closing_time': 1774885645.0, 'created_time': 1773859031.182409, 'last_price_update_time': 1774780605.502399}
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HC04393') HTTP/1.1" 204 0
2026-03-29 10:36:45 [auto1.de] INFO: Found listing with ID: DP06637
2026-03-29 10:36:45 [auto1.de] INFO: Found listing with ID: NG65344
2026-03-29 10:36:45 [auto1.de] INFO: Found listing with ID: XT30705
2026-03-29 10:36:45 [auto1.de] INFO: Found listing with ID: JC50514
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC50514%27 HTTP/1.1" 200 None
2026-03-29 10:36:45 [auto1.de] INFO: Scrape type for JC50514: 2
2026-03-29 10:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c537e97a-8e4e-5e8d-a796-e7d1620a3ef0 with identifier: JC50514
2026-03-29 10:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c537e97a-8e4e-5e8d-a796-e7d1620a3ef0 with scrape type 2
2026-03-29 10:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c537e97a-8e4e-5e8d-a796-e7d1620a3ef0 with scrape type 2
2026-03-29 10:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c537e97a-8e4e-5e8d-a796-e7d1620a3ef0, identifier: JC50514
2026-03-29 10:36:45 [auto1.de] INFO: Found listing with ID: ZV78302
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV78302%27 HTTP/1.1" 200 None
2026-03-29 10:36:45 [auto1.de] INFO: Scrape type for ZV78302: 1
2026-03-29 10:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c537e97a-8e4e-5e8d-a796-e7d1620a3ef0 with identifier: JC50514
2026-03-29 10:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c537e97a-8e4e-5e8d-a796-e7d1620a3ef0 with identifier: JC50514
2026-03-29 10:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c537e97a-8e4e-5e8d-a796-e7d1620a3ef0 with identifier: JC50514 to the API
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:01:10Z',
 'fuel_type': 'diesel',
 'id': 'c537e97a-8e4e-5e8d-a796-e7d1620a3ef0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC50514',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 250747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-01',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.9 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2007}
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC50514%27 HTTP/1.1" 200 None
2026-03-29 10:36:46 [auto1.de] INFO: Saving data for JC50514: {'auction_closing_time': 1774882870.0, 'created_time': 1773429327.007959, 'last_price_update_time': 1774780606.128821}
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JC50514') HTTP/1.1" 204 0
2026-03-29 10:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c with identifier: GT54138
2026-03-29 10:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c with scrape type 1
2026-03-29 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F3a%252F663aff87a58fd4912ceb44b09abae5e1%252Fpa%252FGT54138_7c2c8aeca78f17bc28c818c29418b40d.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/3a/663aff87a58fd4912ceb44b09abae5e1/pa/GT54138_7c2c8aeca78f17bc28c818c29418b40d.jpg already downloaded
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F3a%252F663aff87a58fd4912ceb44b09abae5e1%252Fpa%252FGT54138_c693c72f58ed259f301e9e13b0e87541.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/3a/663aff87a58fd4912ceb44b09abae5e1/pa/GT54138_c693c72f58ed259f301e9e13b0e87541.jpg already downloaded
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F3a%252F663aff87a58fd4912ceb44b09abae5e1%252Fpa%252FGT54138_9b00602dfd0e710ee8f447f1c9ae2f8c.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/3a/663aff87a58fd4912ceb44b09abae5e1/pa/GT54138_9b00602dfd0e710ee8f447f1c9ae2f8c.jpg already downloaded
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F3a%252F663aff87a58fd4912ceb44b09abae5e1%252Fpa%252FGT54138_bfb401072dda549690514b0afe616acd.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/3a/663aff87a58fd4912ceb44b09abae5e1/pa/GT54138_bfb401072dda549690514b0afe616acd.jpg already downloaded
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F3a%252F663aff87a58fd4912ceb44b09abae5e1%252Fpa%252FGT54138_ee99a7538a69548e0b323c633ce74d1c.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/3a/663aff87a58fd4912ceb44b09abae5e1/pa/GT54138_ee99a7538a69548e0b323c633ce74d1c.jpg already downloaded
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F3a%252F663aff87a58fd4912ceb44b09abae5e1%252Fpa%252FGT54138_80ba817e924cc18dbe2ec2fc4bbdae6a.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/3a/663aff87a58fd4912ceb44b09abae5e1/pa/GT54138_80ba817e924cc18dbe2ec2fc4bbdae6a.jpg already downloaded
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F3a%252F663aff87a58fd4912ceb44b09abae5e1%252Fpa%252FGT54138_3e7427eac160061c013563f4b210a519.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/3a/663aff87a58fd4912ceb44b09abae5e1/pa/GT54138_3e7427eac160061c013563f4b210a519.jpg already downloaded
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F3a%252F663aff87a58fd4912ceb44b09abae5e1%252Fpa%252FGT54138_e1b4d8b585a44fcdf094b77cc1109010.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/3a/663aff87a58fd4912ceb44b09abae5e1/pa/GT54138_e1b4d8b585a44fcdf094b77cc1109010.jpg already downloaded
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F3a%252F663aff87a58fd4912ceb44b09abae5e1%252Fpa%252FGT54138_7055a32ae24b6b9416d7aaccdf349a70.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/3a/663aff87a58fd4912ceb44b09abae5e1/pa/GT54138_7055a32ae24b6b9416d7aaccdf349a70.jpg already downloaded
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F3a%252F663aff87a58fd4912ceb44b09abae5e1%252Fpa%252FGT54138_b85099099ea5a11db6fb46970765bccb.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/3a/663aff87a58fd4912ceb44b09abae5e1/pa/GT54138_b85099099ea5a11db6fb46970765bccb.jpg already downloaded
2026-03-29 10:36:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c, identifier: GT54138
2026-03-29 10:36:46 [auto1.de] INFO: Found listing with ID: AD00479
2026-03-29 10:36:46 [auto1.de] INFO: Found listing with ID: CL69426
2026-03-29 10:36:46 [auto1.de] INFO: Found listing with ID: TS98691
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS98691%27 HTTP/1.1" 200 None
2026-03-29 10:36:46 [auto1.de] INFO: Scrape type for TS98691: 2
2026-03-29 10:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6786568e-a3c1-5e4f-a834-ecf2d943ba35 with identifier: TS98691
2026-03-29 10:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6786568e-a3c1-5e4f-a834-ecf2d943ba35 with scrape type 2
2026-03-29 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6786568e-a3c1-5e4f-a834-ecf2d943ba35 with scrape type 2
2026-03-29 10:36:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6786568e-a3c1-5e4f-a834-ecf2d943ba35, identifier: TS98691
2026-03-29 10:36:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c with identifier: GT54138
2026-03-29 10:36:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c with identifier: GT54138
2026-03-29 10:36:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c with identifier: GT54138 to the API
2026-03-29 10:36:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GT54138>
{'auction_title': '',
 'c_o_2_emission_value': 32,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'engine_horse_power': 224,
 'expiration_date': '2026-03-30T15:29:08Z',
 'fuel_type': 'hybrid',
 'id': '62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT54138',
 'listing': 'auction',
 'location': 'DE, Helvesiek',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 115446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img66/3a/663aff87a58fd4912ceb44b09abae5e1/pa/GT54138_7c2c8aeca78f17bc28c818c29418b40d.jpg',
                'https://img-pa.auto1.com/img66/3a/663aff87a58fd4912ceb44b09abae5e1/pa/GT54138_c693c72f58ed259f301e9e13b0e87541.jpg',
                'https://img-pa.auto1.com/img66/3a/663aff87a58fd4912ceb44b09abae5e1/pa/GT54138_9b00602dfd0e710ee8f447f1c9ae2f8c.jpg',
                'https://img-pa.auto1.com/img66/3a/663aff87a58fd4912ceb44b09abae5e1/pa/GT54138_bfb401072dda549690514b0afe616acd.jpg',
                'https://img-pa.auto1.com/img66/3a/663aff87a58fd4912ceb44b09abae5e1/pa/GT54138_ee99a7538a69548e0b323c633ce74d1c.jpg',
                'https://img-pa.auto1.com/img66/3a/663aff87a58fd4912ceb44b09abae5e1/pa/GT54138_80ba817e924cc18dbe2ec2fc4bbdae6a.jpg',
                'https://img-pa.auto1.com/img66/3a/663aff87a58fd4912ceb44b09abae5e1/pa/GT54138_3e7427eac160061c013563f4b210a519.jpg',
                'https://img-pa.auto1.com/img66/3a/663aff87a58fd4912ceb44b09abae5e1/pa/GT54138_e1b4d8b585a44fcdf094b77cc1109010.jpg',
                'https://img-pa.auto1.com/img66/3a/663aff87a58fd4912ceb44b09abae5e1/pa/GT54138_7055a32ae24b6b9416d7aaccdf349a70.jpg',
                'https://img-pa.auto1.com/img66/3a/663aff87a58fd4912ceb44b09abae5e1/pa/GT54138_b85099099ea5a11db6fb46970765bccb.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c/62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/3a/663aff87a58fd4912ceb44b09abae5e1/pa/GT54138_7c2c8aeca78f17bc28c818c29418b40d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c/62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72818,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/3a/663aff87a58fd4912ceb44b09abae5e1/pa/GT54138_c693c72f58ed259f301e9e13b0e87541.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c/62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61229,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/3a/663aff87a58fd4912ceb44b09abae5e1/pa/GT54138_9b00602dfd0e710ee8f447f1c9ae2f8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c/62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/3a/663aff87a58fd4912ceb44b09abae5e1/pa/GT54138_bfb401072dda549690514b0afe616acd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c/62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63210,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/3a/663aff87a58fd4912ceb44b09abae5e1/pa/GT54138_ee99a7538a69548e0b323c633ce74d1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c/62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63573,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/3a/663aff87a58fd4912ceb44b09abae5e1/pa/GT54138_80ba817e924cc18dbe2ec2fc4bbdae6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c/62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/3a/663aff87a58fd4912ceb44b09abae5e1/pa/GT54138_3e7427eac160061c013563f4b210a519.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c/62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/3a/663aff87a58fd4912ceb44b09abae5e1/pa/GT54138_e1b4d8b585a44fcdf094b77cc1109010.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c/62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66766,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/3a/663aff87a58fd4912ceb44b09abae5e1/pa/GT54138_7055a32ae24b6b9416d7aaccdf349a70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c/62c480c0-28ef-5cb9-b1ee-0f1306e9bc1c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/3a/663aff87a58fd4912ceb44b09abae5e1/pa/GT54138_b85099099ea5a11db6fb46970765bccb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-01-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2021}
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT54138%27 HTTP/1.1" 200 None
2026-03-29 10:36:47 [auto1.de] INFO: Saving data for GT54138: {'created_time': 1774780607.729723, 'last_price_update_time': 1774780607.729734, 'auction_closing_time': 1774884548.0}
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT54138') HTTP/1.1" 204 0
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: CZ47065
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: VX94865
2026-03-29 10:36:47 [auto1.de] INFO: Found listing with ID: ES20413
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES20413%27 HTTP/1.1" 200 None
2026-03-29 10:36:47 [auto1.de] INFO: Scrape type for ES20413: 2
2026-03-29 10:36:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90a3d64c-8dde-5b5b-8f48-d234598f6c82 with identifier: ES20413
2026-03-29 10:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90a3d64c-8dde-5b5b-8f48-d234598f6c82 with scrape type 2
2026-03-29 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90a3d64c-8dde-5b5b-8f48-d234598f6c82 with scrape type 2
2026-03-29 10:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90a3d64c-8dde-5b5b-8f48-d234598f6c82, identifier: ES20413
2026-03-29 10:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6786568e-a3c1-5e4f-a834-ecf2d943ba35 with identifier: TS98691
2026-03-29 10:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6786568e-a3c1-5e4f-a834-ecf2d943ba35 with identifier: TS98691
2026-03-29 10:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6786568e-a3c1-5e4f-a834-ecf2d943ba35 with identifier: TS98691 to the API
2026-03-29 10:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:30:22Z',
 'fuel_type': 'petrol',
 'id': '6786568e-a3c1-5e4f-a834-ecf2d943ba35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS98691',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 185952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-10',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.8 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-29 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS98691%27 HTTP/1.1" 200 None
2026-03-29 10:36:48 [auto1.de] INFO: Saving data for TS98691: {'auction_closing_time': 1774884622.0, 'created_time': 1773945326.381923, 'last_price_update_time': 1774780608.27463}
2026-03-29 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TS98691') HTTP/1.1" 204 0
2026-03-29 10:36:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90a3d64c-8dde-5b5b-8f48-d234598f6c82 with identifier: ES20413
2026-03-29 10:36:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90a3d64c-8dde-5b5b-8f48-d234598f6c82 with identifier: ES20413
2026-03-29 10:36:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90a3d64c-8dde-5b5b-8f48-d234598f6c82 with identifier: ES20413 to the API
2026-03-29 10:36:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:34:37Z',
 'fuel_type': 'petrol',
 'id': '90a3d64c-8dde-5b5b-8f48-d234598f6c82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES20413',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Bravo',
 'odometer': 169294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-01-21',
 'seller_name': None,
 'title': 'Fiat Bravo 1.4 Turbo T JET Dynamic',
 'transmission': 'manual',
 'trim': 'T JET Dynamic',
 'year': 2008}
2026-03-29 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES20413%27 HTTP/1.1" 200 None
2026-03-29 10:36:48 [auto1.de] INFO: Saving data for ES20413: {'auction_closing_time': 1774884877.0, 'created_time': 1773860272.902876, 'last_price_update_time': 1774780608.817928}
2026-03-29 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ES20413') HTTP/1.1" 204 0
2026-03-29 10:36:48 [auto1.de] INFO: Found listing with ID: WJ52801
2026-03-29 10:36:48 [auto1.de] INFO: Found listing with ID: KH18492
2026-03-29 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH18492%27 HTTP/1.1" 200 None
2026-03-29 10:36:48 [auto1.de] INFO: Scrape type for KH18492: 2
2026-03-29 10:36:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5674c1c2-3070-5f30-ace3-5d01ad393460 with identifier: KH18492
2026-03-29 10:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5674c1c2-3070-5f30-ace3-5d01ad393460 with scrape type 2
2026-03-29 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5674c1c2-3070-5f30-ace3-5d01ad393460 with scrape type 2
2026-03-29 10:36:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5674c1c2-3070-5f30-ace3-5d01ad393460, identifier: KH18492
2026-03-29 10:36:48 [auto1.de] INFO: Found listing with ID: XE08723
2026-03-29 10:36:48 [auto1.de] INFO: Found listing with ID: AU50389
2026-03-29 10:36:48 [auto1.de] INFO: Found listing with ID: LZ63004
2026-03-29 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ63004%27 HTTP/1.1" 200 None
2026-03-29 10:36:48 [auto1.de] INFO: Scrape type for LZ63004: 2
2026-03-29 10:36:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b289fac-4b2a-5678-855e-aa76a65072e9 with identifier: LZ63004
2026-03-29 10:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b289fac-4b2a-5678-855e-aa76a65072e9 with scrape type 2
2026-03-29 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b289fac-4b2a-5678-855e-aa76a65072e9 with scrape type 2
2026-03-29 10:36:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5b289fac-4b2a-5678-855e-aa76a65072e9, identifier: LZ63004
2026-03-29 10:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5674c1c2-3070-5f30-ace3-5d01ad393460 with identifier: KH18492
2026-03-29 10:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5674c1c2-3070-5f30-ace3-5d01ad393460 with identifier: KH18492
2026-03-29 10:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5674c1c2-3070-5f30-ace3-5d01ad393460 with identifier: KH18492 to the API
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:12:22Z',
 'fuel_type': 'petrol',
 'id': '5674c1c2-3070-5f30-ace3-5d01ad393460',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH18492',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 164486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-10',
 'seller_name': None,
 'title': "Kia cee'd 1.6 Mind",
 'transmission': 'manual',
 'trim': 'Mind',
 'year': 2010}
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH18492%27 HTTP/1.1" 200 None
2026-03-29 10:36:49 [auto1.de] INFO: Saving data for KH18492: {'auction_closing_time': 1774883542.0, 'created_time': 1773429218.619818, 'last_price_update_time': 1774780609.476706}
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KH18492') HTTP/1.1" 204 0
2026-03-29 10:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MH98673> (referer: https://www.auto1.com/v1/car-details-view/MH98673/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5b289fac-4b2a-5678-855e-aa76a65072e9 with identifier: LZ63004
2026-03-29 10:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5b289fac-4b2a-5678-855e-aa76a65072e9 with identifier: LZ63004
2026-03-29 10:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5b289fac-4b2a-5678-855e-aa76a65072e9 with identifier: LZ63004 to the API
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:18:10Z',
 'fuel_type': 'petrol',
 'id': '5b289fac-4b2a-5678-855e-aa76a65072e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ63004',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 120294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-02-28',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2003}
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ63004%27 HTTP/1.1" 200 None
2026-03-29 10:36:49 [auto1.de] INFO: Saving data for LZ63004: {'auction_closing_time': 1774883890.0, 'created_time': 1774638259.469958, 'last_price_update_time': 1774780609.954331}
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ63004') HTTP/1.1" 204 0
2026-03-29 10:36:49 [auto1.de] INFO: Found listing with ID: TC78124
2026-03-29 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC78124%27 HTTP/1.1" 200 None
2026-03-29 10:36:50 [auto1.de] INFO: Scrape type for TC78124: 2
2026-03-29 10:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5954ae8a-a709-55bb-8426-8a6fae9d3171 with identifier: TC78124
2026-03-29 10:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5954ae8a-a709-55bb-8426-8a6fae9d3171 with scrape type 2
2026-03-29 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5954ae8a-a709-55bb-8426-8a6fae9d3171 with scrape type 2
2026-03-29 10:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5954ae8a-a709-55bb-8426-8a6fae9d3171, identifier: TC78124
2026-03-29 10:36:50 [auto1.de] INFO: Found listing with ID: VT21239
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT21239%27 HTTP/1.1" 200 None
2026-03-29 10:36:50 [auto1.de] INFO: Scrape type for VT21239: 1
2026-03-29 10:36:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5954ae8a-a709-55bb-8426-8a6fae9d3171 with identifier: TC78124
2026-03-29 10:36:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5954ae8a-a709-55bb-8426-8a6fae9d3171 with identifier: TC78124
2026-03-29 10:36:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5954ae8a-a709-55bb-8426-8a6fae9d3171 with identifier: TC78124 to the API
2026-03-29 10:36:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:03:29Z',
 'fuel_type': 'petrol',
 'id': '5954ae8a-a709-55bb-8426-8a6fae9d3171',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC78124',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 101154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-11',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI GT Line 4WD',
 'transmission': 'automatic',
 'trim': 'GT Line 4WD',
 'year': 2018}
2026-03-29 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC78124%27 HTTP/1.1" 200 None
2026-03-29 10:36:51 [auto1.de] INFO: Saving data for TC78124: {'auction_closing_time': 1774883009.0, 'created_time': 1773946068.821789, 'last_price_update_time': 1774780611.333795}
2026-03-29 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TC78124') HTTP/1.1" 204 0
2026-03-29 10:36:51 [auto1.de] INFO: Found listing with ID: PY29315
2026-03-29 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY29315%27 HTTP/1.1" 200 None
2026-03-29 10:36:51 [auto1.de] INFO: Scrape type for PY29315: 2
2026-03-29 10:36:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17d0d5a3-fc6b-5290-8ebc-c0603953a1a7 with identifier: PY29315
2026-03-29 10:36:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17d0d5a3-fc6b-5290-8ebc-c0603953a1a7 with scrape type 2
2026-03-29 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17d0d5a3-fc6b-5290-8ebc-c0603953a1a7 with scrape type 2
2026-03-29 10:36:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17d0d5a3-fc6b-5290-8ebc-c0603953a1a7, identifier: PY29315
2026-03-29 10:36:51 [auto1.de] INFO: Found listing with ID: ME62571
2026-03-29 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME62571%27 HTTP/1.1" 200 None
2026-03-29 10:36:51 [auto1.de] INFO: Scrape type for ME62571: 2
2026-03-29 10:36:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e83560a-2b84-5cb5-8a75-7a127e49fd88 with identifier: ME62571
2026-03-29 10:36:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e83560a-2b84-5cb5-8a75-7a127e49fd88 with scrape type 2
2026-03-29 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e83560a-2b84-5cb5-8a75-7a127e49fd88 with scrape type 2
2026-03-29 10:36:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e83560a-2b84-5cb5-8a75-7a127e49fd88, identifier: ME62571
2026-03-29 10:36:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17d0d5a3-fc6b-5290-8ebc-c0603953a1a7 with identifier: PY29315
2026-03-29 10:36:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17d0d5a3-fc6b-5290-8ebc-c0603953a1a7 with identifier: PY29315
2026-03-29 10:36:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17d0d5a3-fc6b-5290-8ebc-c0603953a1a7 with identifier: PY29315 to the API
2026-03-29 10:36:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:25:05Z',
 'fuel_type': 'petrol',
 'id': '17d0d5a3-fc6b-5290-8ebc-c0603953a1a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY29315',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 148738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-15',
 'seller_name': None,
 'title': 'Dacia Sandero 1.2 Eco',
 'transmission': 'manual',
 'trim': 'Eco',
 'year': 2009}
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY29315%27 HTTP/1.1" 200 None
2026-03-29 10:36:52 [auto1.de] INFO: Saving data for PY29315: {'auction_closing_time': 1774884305.0, 'created_time': 1773775603.012367, 'last_price_update_time': 1774780612.059851}
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY29315') HTTP/1.1" 204 0
2026-03-29 10:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e83560a-2b84-5cb5-8a75-7a127e49fd88 with identifier: ME62571
2026-03-29 10:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e83560a-2b84-5cb5-8a75-7a127e49fd88 with identifier: ME62571
2026-03-29 10:36:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e83560a-2b84-5cb5-8a75-7a127e49fd88 with identifier: ME62571 to the API
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:07:23Z',
 'fuel_type': 'petrol',
 'id': '5e83560a-2b84-5cb5-8a75-7a127e49fd88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME62571',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Bora',
 'odometer': 265740,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-09-08',
 'seller_name': None,
 'title': 'Volkswagen Bora 1.6 Pacific',
 'transmission': 'manual',
 'trim': 'Pacific',
 'year': 2004}
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME62571%27 HTTP/1.1" 200 None
2026-03-29 10:36:52 [auto1.de] INFO: Saving data for ME62571: {'auction_closing_time': 1774883243.0, 'created_time': 1773830420.519557, 'last_price_update_time': 1774780612.515237}
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ME62571') HTTP/1.1" 204 0
2026-03-29 10:36:52 [auto1.de] INFO: Found listing with ID: WW76911
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW76911%27 HTTP/1.1" 200 None
2026-03-29 10:36:52 [auto1.de] INFO: Scrape type for WW76911: 1
2026-03-29 10:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YK45245/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46331702-81ec-5126-aacd-b58fac8f37c1 with identifier: MH98673
2026-03-29 10:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46331702-81ec-5126-aacd-b58fac8f37c1 with scrape type 1
2026-03-29 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 46331702-81ec-5126-aacd-b58fac8f37c1
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fdb%252Feadbc12d14a95bbe634a2183ee7ea874%252Fpa%252FMH98673_aaf1b7b8528aaf0d1a562baddb06bfd5.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/db/eadbc12d14a95bbe634a2183ee7ea874/pa/MH98673_aaf1b7b8528aaf0d1a562baddb06bfd5.jpg already downloaded
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fdb%252Feadbc12d14a95bbe634a2183ee7ea874%252Fpa%252FMH98673_38486365410e6a471f542e3ec8136ef4.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/db/eadbc12d14a95bbe634a2183ee7ea874/pa/MH98673_38486365410e6a471f542e3ec8136ef4.jpg already downloaded
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fdb%252Feadbc12d14a95bbe634a2183ee7ea874%252Fpa%252FMH98673_5eaadc358469485db9f7de9f74872983.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/db/eadbc12d14a95bbe634a2183ee7ea874/pa/MH98673_5eaadc358469485db9f7de9f74872983.jpg already downloaded
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fdb%252Feadbc12d14a95bbe634a2183ee7ea874%252Fpa%252FMH98673_549595515646681c1b50207923424714.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/db/eadbc12d14a95bbe634a2183ee7ea874/pa/MH98673_549595515646681c1b50207923424714.jpg already downloaded
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fdb%252Feadbc12d14a95bbe634a2183ee7ea874%252Fpa%252FMH98673_b29ccdc21b50fa3e2890aa10d64ae468.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/db/eadbc12d14a95bbe634a2183ee7ea874/pa/MH98673_b29ccdc21b50fa3e2890aa10d64ae468.jpg already downloaded
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fdb%252Feadbc12d14a95bbe634a2183ee7ea874%252Fpa%252FMH98673_f468b5580e232c71b7ecd3b3e0d87082.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/db/eadbc12d14a95bbe634a2183ee7ea874/pa/MH98673_f468b5580e232c71b7ecd3b3e0d87082.jpg already downloaded
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fdb%252Feadbc12d14a95bbe634a2183ee7ea874%252Fpa%252FMH98673_58d6dbd1411fac7377641ff9bf8ccb0e.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/db/eadbc12d14a95bbe634a2183ee7ea874/pa/MH98673_58d6dbd1411fac7377641ff9bf8ccb0e.jpg already downloaded
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fdb%252Feadbc12d14a95bbe634a2183ee7ea874%252Fpa%252FMH98673_86789191033c42371554d93dce4304df.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/db/eadbc12d14a95bbe634a2183ee7ea874/pa/MH98673_86789191033c42371554d93dce4304df.jpg already downloaded
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fdb%252Feadbc12d14a95bbe634a2183ee7ea874%252Fpa%252FMH98673_5604d60ffe1217fd0ff0e602d2103bb7.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/db/eadbc12d14a95bbe634a2183ee7ea874/pa/MH98673_5604d60ffe1217fd0ff0e602d2103bb7.jpg already downloaded
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fdb%252Feadbc12d14a95bbe634a2183ee7ea874%252Fpa%252FMH98673_650c80fecf5370156c5c9c9d5d1a6368.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/db/eadbc12d14a95bbe634a2183ee7ea874/pa/MH98673_650c80fecf5370156c5c9c9d5d1a6368.jpg already downloaded
2026-03-29 10:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46331702-81ec-5126-aacd-b58fac8f37c1, identifier: MH98673
2026-03-29 10:36:52 [auto1.de] INFO: Found listing with ID: KJ28184
2026-03-29 10:36:52 [auto1.de] INFO: Found listing with ID: NV69214
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV69214%27 HTTP/1.1" 200 None
2026-03-29 10:36:52 [auto1.de] INFO: Scrape type for NV69214: 2
2026-03-29 10:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acd34e51-4672-5868-afd1-7fe7c0d3ad8d with identifier: NV69214
2026-03-29 10:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acd34e51-4672-5868-afd1-7fe7c0d3ad8d with scrape type 2
2026-03-29 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acd34e51-4672-5868-afd1-7fe7c0d3ad8d with scrape type 2
2026-03-29 10:36:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acd34e51-4672-5868-afd1-7fe7c0d3ad8d, identifier: NV69214
2026-03-29 10:36:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46331702-81ec-5126-aacd-b58fac8f37c1 with identifier: MH98673
2026-03-29 10:36:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46331702-81ec-5126-aacd-b58fac8f37c1 with identifier: MH98673
2026-03-29 10:36:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46331702-81ec-5126-aacd-b58fac8f37c1 with identifier: MH98673 to the API
2026-03-29 10:36:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MH98673>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:09:10Z',
 'fuel_type': 'diesel',
 'id': '46331702-81ec-5126-aacd-b58fac8f37c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH98673',
 'listing': 'auction',
 'location': 'DE, Kandel',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 221500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgea/db/eadbc12d14a95bbe634a2183ee7ea874/pa/MH98673_aaf1b7b8528aaf0d1a562baddb06bfd5.jpg',
                'https://img-pa.auto1.com/imgea/db/eadbc12d14a95bbe634a2183ee7ea874/pa/MH98673_38486365410e6a471f542e3ec8136ef4.jpg',
                'https://img-pa.auto1.com/imgea/db/eadbc12d14a95bbe634a2183ee7ea874/pa/MH98673_5eaadc358469485db9f7de9f74872983.jpg',
                'https://img-pa.auto1.com/imgea/db/eadbc12d14a95bbe634a2183ee7ea874/pa/MH98673_549595515646681c1b50207923424714.jpg',
                'https://img-pa.auto1.com/imgea/db/eadbc12d14a95bbe634a2183ee7ea874/pa/MH98673_b29ccdc21b50fa3e2890aa10d64ae468.jpg',
                'https://img-pa.auto1.com/imgea/db/eadbc12d14a95bbe634a2183ee7ea874/pa/MH98673_f468b5580e232c71b7ecd3b3e0d87082.jpg',
                'https://img-pa.auto1.com/imgea/db/eadbc12d14a95bbe634a2183ee7ea874/pa/MH98673_58d6dbd1411fac7377641ff9bf8ccb0e.jpg',
                'https://img-pa.auto1.com/imgea/db/eadbc12d14a95bbe634a2183ee7ea874/pa/MH98673_86789191033c42371554d93dce4304df.jpg',
                'https://img-pa.auto1.com/imgea/db/eadbc12d14a95bbe634a2183ee7ea874/pa/MH98673_5604d60ffe1217fd0ff0e602d2103bb7.jpg',
                'https://img-pa.auto1.com/imgea/db/eadbc12d14a95bbe634a2183ee7ea874/pa/MH98673_650c80fecf5370156c5c9c9d5d1a6368.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46331702-81ec-5126-aacd-b58fac8f37c1/46331702-81ec-5126-aacd-b58fac8f37c1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/db/eadbc12d14a95bbe634a2183ee7ea874/pa/MH98673_aaf1b7b8528aaf0d1a562baddb06bfd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46331702-81ec-5126-aacd-b58fac8f37c1/46331702-81ec-5126-aacd-b58fac8f37c1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66420,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/db/eadbc12d14a95bbe634a2183ee7ea874/pa/MH98673_38486365410e6a471f542e3ec8136ef4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46331702-81ec-5126-aacd-b58fac8f37c1/46331702-81ec-5126-aacd-b58fac8f37c1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/db/eadbc12d14a95bbe634a2183ee7ea874/pa/MH98673_5eaadc358469485db9f7de9f74872983.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46331702-81ec-5126-aacd-b58fac8f37c1/46331702-81ec-5126-aacd-b58fac8f37c1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/db/eadbc12d14a95bbe634a2183ee7ea874/pa/MH98673_549595515646681c1b50207923424714.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46331702-81ec-5126-aacd-b58fac8f37c1/46331702-81ec-5126-aacd-b58fac8f37c1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/db/eadbc12d14a95bbe634a2183ee7ea874/pa/MH98673_b29ccdc21b50fa3e2890aa10d64ae468.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46331702-81ec-5126-aacd-b58fac8f37c1/46331702-81ec-5126-aacd-b58fac8f37c1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/db/eadbc12d14a95bbe634a2183ee7ea874/pa/MH98673_f468b5580e232c71b7ecd3b3e0d87082.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46331702-81ec-5126-aacd-b58fac8f37c1/46331702-81ec-5126-aacd-b58fac8f37c1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/db/eadbc12d14a95bbe634a2183ee7ea874/pa/MH98673_58d6dbd1411fac7377641ff9bf8ccb0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46331702-81ec-5126-aacd-b58fac8f37c1/46331702-81ec-5126-aacd-b58fac8f37c1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71759,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/db/eadbc12d14a95bbe634a2183ee7ea874/pa/MH98673_86789191033c42371554d93dce4304df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46331702-81ec-5126-aacd-b58fac8f37c1/46331702-81ec-5126-aacd-b58fac8f37c1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/db/eadbc12d14a95bbe634a2183ee7ea874/pa/MH98673_5604d60ffe1217fd0ff0e602d2103bb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46331702-81ec-5126-aacd-b58fac8f37c1/46331702-81ec-5126-aacd-b58fac8f37c1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/db/eadbc12d14a95bbe634a2183ee7ea874/pa/MH98673_650c80fecf5370156c5c9c9d5d1a6368.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 sDrive 18d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-29 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH98673%27 HTTP/1.1" 200 None
2026-03-29 10:36:53 [auto1.de] INFO: Saving data for MH98673: {'created_time': 1774780613.474014, 'last_price_update_time': 1774780613.474023, 'auction_closing_time': 1774883350.0}
2026-03-29 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH98673') HTTP/1.1" 204 0
2026-03-29 10:36:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acd34e51-4672-5868-afd1-7fe7c0d3ad8d with identifier: NV69214
2026-03-29 10:36:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acd34e51-4672-5868-afd1-7fe7c0d3ad8d with identifier: NV69214
2026-03-29 10:36:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acd34e51-4672-5868-afd1-7fe7c0d3ad8d with identifier: NV69214 to the API
2026-03-29 10:36:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:53:54Z',
 'fuel_type': 'diesel',
 'id': 'acd34e51-4672-5868-afd1-7fe7c0d3ad8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV69214',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 97504,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-24',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI Sound BlueMotion',
 'transmission': 'manual',
 'trim': 'Sound BlueMotion',
 'year': 2017}
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV69214%27 HTTP/1.1" 200 None
2026-03-29 10:36:54 [auto1.de] INFO: Saving data for NV69214: {'auction_closing_time': 1774886034.0, 'created_time': 1774550905.353575, 'last_price_update_time': 1774780614.741519}
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV69214') HTTP/1.1" 204 0
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: EE66446
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE66446%27 HTTP/1.1" 200 None
2026-03-29 10:36:54 [auto1.de] INFO: Scrape type for EE66446: 2
2026-03-29 10:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81c4a184-0523-5ff0-8b65-156c28e994b7 with identifier: EE66446
2026-03-29 10:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81c4a184-0523-5ff0-8b65-156c28e994b7 with scrape type 2
2026-03-29 10:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81c4a184-0523-5ff0-8b65-156c28e994b7 with scrape type 2
2026-03-29 10:36:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81c4a184-0523-5ff0-8b65-156c28e994b7, identifier: EE66446
2026-03-29 10:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: UT98357
2026-03-29 10:36:54 [auto1.de] INFO: Found listing with ID: HY43469
2026-03-29 10:36:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81c4a184-0523-5ff0-8b65-156c28e994b7 with identifier: EE66446
2026-03-29 10:36:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81c4a184-0523-5ff0-8b65-156c28e994b7 with identifier: EE66446
2026-03-29 10:36:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81c4a184-0523-5ff0-8b65-156c28e994b7 with identifier: EE66446 to the API
2026-03-29 10:36:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:47:34Z',
 'fuel_type': 'petrol',
 'id': '81c4a184-0523-5ff0-8b65-156c28e994b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE66446',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 209407,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-14',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.6 Avantage',
 'transmission': 'manual',
 'trim': 'Avantage',
 'year': 2007}
2026-03-29 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE66446%27 HTTP/1.1" 200 None
2026-03-29 10:36:55 [auto1.de] INFO: Saving data for EE66446: {'auction_closing_time': 1774885654.0, 'created_time': 1774638548.325725, 'last_price_update_time': 1774780615.302295}
2026-03-29 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE66446') HTTP/1.1" 204 0
2026-03-29 10:36:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UJ23150/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:55 [auto1.de] INFO: Found listing with ID: SR43778
2026-03-29 10:36:55 [auto1.de] INFO: Found listing with ID: GV67741
2026-03-29 10:36:55 [auto1.de] INFO: Found listing with ID: VY63466
2026-03-29 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY63466%27 HTTP/1.1" 200 None
2026-03-29 10:36:55 [auto1.de] INFO: Scrape type for VY63466: 2
2026-03-29 10:36:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 970d396a-0953-5390-b82a-2bd774787613 with identifier: VY63466
2026-03-29 10:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 970d396a-0953-5390-b82a-2bd774787613 with scrape type 2
2026-03-29 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 970d396a-0953-5390-b82a-2bd774787613 with scrape type 2
2026-03-29 10:36:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 970d396a-0953-5390-b82a-2bd774787613, identifier: VY63466
2026-03-29 10:36:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 970d396a-0953-5390-b82a-2bd774787613 with identifier: VY63466
2026-03-29 10:36:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 970d396a-0953-5390-b82a-2bd774787613 with identifier: VY63466
2026-03-29 10:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 970d396a-0953-5390-b82a-2bd774787613 with identifier: VY63466 to the API
2026-03-29 10:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:52:29Z',
 'fuel_type': 'diesel',
 'id': '970d396a-0953-5390-b82a-2bd774787613',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY63466',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Voyager',
 'odometer': 186974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-12',
 'seller_name': None,
 'title': 'Lancia Voyager 2.8 JTDM Platinum',
 'transmission': 'automatic',
 'trim': 'Platinum',
 'year': 2012}
2026-03-29 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY63466%27 HTTP/1.1" 200 None
2026-03-29 10:36:55 [auto1.de] INFO: Saving data for VY63466: {'auction_closing_time': 1774885949.0, 'created_time': 1774637407.81463, 'last_price_update_time': 1774780615.859532}
2026-03-29 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY63466') HTTP/1.1" 204 0
2026-03-29 10:36:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:55 [auto1.de] INFO: Found listing with ID: PF70516
2026-03-29 10:36:55 [auto1.de] INFO: Found listing with ID: MB34428
2026-03-29 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB34428%27 HTTP/1.1" 200 None
2026-03-29 10:36:55 [auto1.de] INFO: Scrape type for MB34428: 2
2026-03-29 10:36:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: caaefc81-fec0-58b7-96a3-46d73fabf7a7 with identifier: MB34428
2026-03-29 10:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caaefc81-fec0-58b7-96a3-46d73fabf7a7 with scrape type 2
2026-03-29 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item caaefc81-fec0-58b7-96a3-46d73fabf7a7 with scrape type 2
2026-03-29 10:36:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: caaefc81-fec0-58b7-96a3-46d73fabf7a7, identifier: MB34428
2026-03-29 10:36:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: caaefc81-fec0-58b7-96a3-46d73fabf7a7 with identifier: MB34428
2026-03-29 10:36:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: caaefc81-fec0-58b7-96a3-46d73fabf7a7 with identifier: MB34428
2026-03-29 10:36:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: caaefc81-fec0-58b7-96a3-46d73fabf7a7 with identifier: MB34428 to the API
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:30:49Z',
 'fuel_type': 'petrol',
 'id': 'caaefc81-fec0-58b7-96a3-46d73fabf7a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB34428',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 210558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-03',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2007}
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB34428%27 HTTP/1.1" 200 None
2026-03-29 10:36:56 [auto1.de] INFO: Saving data for MB34428: {'auction_closing_time': 1774884649.0, 'created_time': 1774638373.716023, 'last_price_update_time': 1774780616.490757}
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MB34428') HTTP/1.1" 204 0
2026-03-29 10:36:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZV78302/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: YY88868
2026-03-29 10:36:56 [auto1.de] INFO: Found listing with ID: PA05830
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA05830%27 HTTP/1.1" 200 None
2026-03-29 10:36:56 [auto1.de] INFO: Scrape type for PA05830: 2
2026-03-29 10:36:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f55467da-7e9d-5f4d-bca4-7d1a3f70c7b7 with identifier: PA05830
2026-03-29 10:36:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f55467da-7e9d-5f4d-bca4-7d1a3f70c7b7 with scrape type 2
2026-03-29 10:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f55467da-7e9d-5f4d-bca4-7d1a3f70c7b7 with scrape type 2
2026-03-29 10:36:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f55467da-7e9d-5f4d-bca4-7d1a3f70c7b7, identifier: PA05830
2026-03-29 10:36:56 [auto1.de] INFO: Channel: 24h | Page: 9 | totalHits: 6726 | hits on page: 40
2026-03-29 10:36:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f55467da-7e9d-5f4d-bca4-7d1a3f70c7b7 with identifier: PA05830
2026-03-29 10:36:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f55467da-7e9d-5f4d-bca4-7d1a3f70c7b7 with identifier: PA05830
2026-03-29 10:36:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f55467da-7e9d-5f4d-bca4-7d1a3f70c7b7 with identifier: PA05830 to the API
2026-03-29 10:36:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:53:30Z',
 'fuel_type': 'diesel',
 'id': 'f55467da-7e9d-5f4d-bca4-7d1a3f70c7b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA05830',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 58232,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1987-03-24',
 'seller_name': None,
 'title': 'Ford Transit 2.5 Diesel Bus FT 100',
 'transmission': 'manual',
 'trim': 'Bus FT 100',
 'year': 1987}
2026-03-29 10:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA05830%27 HTTP/1.1" 200 None
2026-03-29 10:36:57 [auto1.de] INFO: Saving data for PA05830: {'auction_closing_time': 1774886010.0, 'created_time': 1773224377.691535, 'last_price_update_time': 1774780617.913056}
2026-03-29 10:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA05830') HTTP/1.1" 204 0
2026-03-29 10:36:57 [auto1.de] INFO: Found listing with ID: WL17880
2026-03-29 10:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL17880%27 HTTP/1.1" 200 None
2026-03-29 10:36:57 [auto1.de] INFO: Scrape type for WL17880: 1
2026-03-29 10:36:57 [auto1.de] INFO: Found listing with ID: WX30683
2026-03-29 10:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX30683%27 HTTP/1.1" 200 None
2026-03-29 10:36:57 [auto1.de] INFO: Scrape type for WX30683: 2
2026-03-29 10:36:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6dd3594d-8dcb-5df6-ac70-629f031812ac with identifier: WX30683
2026-03-29 10:36:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dd3594d-8dcb-5df6-ac70-629f031812ac with scrape type 2
2026-03-29 10:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6dd3594d-8dcb-5df6-ac70-629f031812ac with scrape type 2
2026-03-29 10:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6dd3594d-8dcb-5df6-ac70-629f031812ac, identifier: WX30683
2026-03-29 10:36:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6dd3594d-8dcb-5df6-ac70-629f031812ac with identifier: WX30683
2026-03-29 10:36:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6dd3594d-8dcb-5df6-ac70-629f031812ac with identifier: WX30683
2026-03-29 10:36:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6dd3594d-8dcb-5df6-ac70-629f031812ac with identifier: WX30683 to the API
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:35:59Z',
 'fuel_type': 'petrol',
 'id': '6dd3594d-8dcb-5df6-ac70-629f031812ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX30683',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Colt',
 'odometer': 164169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-05',
 'seller_name': None,
 'title': 'Mitsubishi Colt 1.1 Inform',
 'transmission': 'manual',
 'trim': 'Inform',
 'year': 2009}
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX30683%27 HTTP/1.1" 200 None
2026-03-29 10:36:58 [auto1.de] INFO: Saving data for WX30683: {'auction_closing_time': 1774884959.0, 'created_time': 1773861194.648874, 'last_price_update_time': 1774780618.625145}
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX30683') HTTP/1.1" 204 0
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: NY52199
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY52199%27 HTTP/1.1" 200 None
2026-03-29 10:36:58 [auto1.de] INFO: Scrape type for NY52199: 1
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: HC78210
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: YK03536
2026-03-29 10:36:58 [auto1.de] INFO: Found listing with ID: HZ13557
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ13557%27 HTTP/1.1" 200 None
2026-03-29 10:36:58 [auto1.de] INFO: Scrape type for HZ13557: 2
2026-03-29 10:36:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e4cb8ac-fc1b-5f53-9953-dcf779bcb4ef with identifier: HZ13557
2026-03-29 10:36:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e4cb8ac-fc1b-5f53-9953-dcf779bcb4ef with scrape type 2
2026-03-29 10:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e4cb8ac-fc1b-5f53-9953-dcf779bcb4ef with scrape type 2
2026-03-29 10:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e4cb8ac-fc1b-5f53-9953-dcf779bcb4ef, identifier: HZ13557
2026-03-29 10:36:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VT21239/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:36:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e4cb8ac-fc1b-5f53-9953-dcf779bcb4ef with identifier: HZ13557
2026-03-29 10:36:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e4cb8ac-fc1b-5f53-9953-dcf779bcb4ef with identifier: HZ13557
2026-03-29 10:36:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e4cb8ac-fc1b-5f53-9953-dcf779bcb4ef with identifier: HZ13557 to the API
2026-03-29 10:36:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:42:38Z',
 'fuel_type': 'petrol',
 'id': '8e4cb8ac-fc1b-5f53-9953-dcf779bcb4ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ13557',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fusion',
 'odometer': 145730,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-10-30',
 'seller_name': None,
 'title': 'Ford Fusion 1.6 Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2003}
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ13557%27 HTTP/1.1" 200 None
2026-03-29 10:36:59 [auto1.de] INFO: Saving data for HZ13557: {'auction_closing_time': 1774885358.0, 'created_time': 1774033521.558895, 'last_price_update_time': 1774780619.278695}
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ13557') HTTP/1.1" 204 0
2026-03-29 10:36:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: CL67465
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL67465%27 HTTP/1.1" 200 None
2026-03-29 10:36:59 [auto1.de] INFO: Scrape type for CL67465: 2
2026-03-29 10:36:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eab8616e-3474-52fb-8bc3-7b99ec85f75f with identifier: CL67465
2026-03-29 10:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eab8616e-3474-52fb-8bc3-7b99ec85f75f with scrape type 2
2026-03-29 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eab8616e-3474-52fb-8bc3-7b99ec85f75f with scrape type 2
2026-03-29 10:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eab8616e-3474-52fb-8bc3-7b99ec85f75f, identifier: CL67465
2026-03-29 10:36:59 [auto1.de] INFO: Found listing with ID: CP72119
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP72119%27 HTTP/1.1" 200 None
2026-03-29 10:36:59 [auto1.de] INFO: Scrape type for CP72119: 2
2026-03-29 10:36:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96e8b7c2-fc2b-5fbe-bbc2-98bf7e8e39a1 with identifier: CP72119
2026-03-29 10:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96e8b7c2-fc2b-5fbe-bbc2-98bf7e8e39a1 with scrape type 2
2026-03-29 10:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96e8b7c2-fc2b-5fbe-bbc2-98bf7e8e39a1 with scrape type 2
2026-03-29 10:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96e8b7c2-fc2b-5fbe-bbc2-98bf7e8e39a1, identifier: CP72119
2026-03-29 10:36:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eab8616e-3474-52fb-8bc3-7b99ec85f75f with identifier: CL67465
2026-03-29 10:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eab8616e-3474-52fb-8bc3-7b99ec85f75f with identifier: CL67465
2026-03-29 10:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eab8616e-3474-52fb-8bc3-7b99ec85f75f with identifier: CL67465 to the API
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:00:57Z',
 'fuel_type': 'petrol',
 'id': 'eab8616e-3474-52fb-8bc3-7b99ec85f75f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL67465',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 146871,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-05',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2010}
2026-03-29 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL67465%27 HTTP/1.1" 200 None
2026-03-29 10:37:00 [auto1.de] INFO: Saving data for CL67465: {'auction_closing_time': 1774882857.0, 'created_time': 1773831744.413293, 'last_price_update_time': 1774780620.064437}
2026-03-29 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL67465') HTTP/1.1" 204 0
2026-03-29 10:37:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96e8b7c2-fc2b-5fbe-bbc2-98bf7e8e39a1 with identifier: CP72119
2026-03-29 10:37:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96e8b7c2-fc2b-5fbe-bbc2-98bf7e8e39a1 with identifier: CP72119
2026-03-29 10:37:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96e8b7c2-fc2b-5fbe-bbc2-98bf7e8e39a1 with identifier: CP72119 to the API
2026-03-29 10:37:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:46:16Z',
 'fuel_type': 'petrol',
 'id': '96e8b7c2-fc2b-5fbe-bbc2-98bf7e8e39a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP72119',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '306',
 'odometer': 183488,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1995-05-28',
 'seller_name': None,
 'title': 'Peugeot 306 1.4 Atoll',
 'transmission': 'manual',
 'trim': 'Atoll',
 'year': 1995}
2026-03-29 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP72119%27 HTTP/1.1" 200 None
2026-03-29 10:37:01 [auto1.de] INFO: Saving data for CP72119: {'auction_closing_time': 1774885576.0, 'created_time': 1774550688.591962, 'last_price_update_time': 1774780621.368834}
2026-03-29 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CP72119') HTTP/1.1" 204 0
2026-03-29 10:37:01 [auto1.de] INFO: Found listing with ID: AX54291
2026-03-29 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX54291%27 HTTP/1.1" 200 None
2026-03-29 10:37:01 [auto1.de] INFO: Scrape type for AX54291: 2
2026-03-29 10:37:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a3f139e-dac2-5210-b581-c38326ebb97c with identifier: AX54291
2026-03-29 10:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a3f139e-dac2-5210-b581-c38326ebb97c with scrape type 2
2026-03-29 10:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a3f139e-dac2-5210-b581-c38326ebb97c with scrape type 2
2026-03-29 10:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0a3f139e-dac2-5210-b581-c38326ebb97c, identifier: AX54291
2026-03-29 10:37:01 [auto1.de] INFO: Found listing with ID: TU13190
2026-03-29 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU13190%27 HTTP/1.1" 200 None
2026-03-29 10:37:01 [auto1.de] INFO: Scrape type for TU13190: 2
2026-03-29 10:37:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c99888af-5bc1-58de-adc6-23888f945e77 with identifier: TU13190
2026-03-29 10:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c99888af-5bc1-58de-adc6-23888f945e77 with scrape type 2
2026-03-29 10:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c99888af-5bc1-58de-adc6-23888f945e77 with scrape type 2
2026-03-29 10:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c99888af-5bc1-58de-adc6-23888f945e77, identifier: TU13190
2026-03-29 10:37:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0a3f139e-dac2-5210-b581-c38326ebb97c with identifier: AX54291
2026-03-29 10:37:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0a3f139e-dac2-5210-b581-c38326ebb97c with identifier: AX54291
2026-03-29 10:37:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0a3f139e-dac2-5210-b581-c38326ebb97c with identifier: AX54291 to the API
2026-03-29 10:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:41:15Z',
 'fuel_type': 'petrol',
 'id': '0a3f139e-dac2-5210-b581-c38326ebb97c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX54291',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 153857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-22',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2009}
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX54291%27 HTTP/1.1" 200 None
2026-03-29 10:37:02 [auto1.de] INFO: Saving data for AX54291: {'auction_closing_time': 1774885275.0, 'created_time': 1773831226.303824, 'last_price_update_time': 1774780622.109027}
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AX54291') HTTP/1.1" 204 0
2026-03-29 10:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c99888af-5bc1-58de-adc6-23888f945e77 with identifier: TU13190
2026-03-29 10:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c99888af-5bc1-58de-adc6-23888f945e77 with identifier: TU13190
2026-03-29 10:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c99888af-5bc1-58de-adc6-23888f945e77 with identifier: TU13190 to the API
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:26:53Z',
 'fuel_type': 'diesel',
 'id': 'c99888af-5bc1-58de-adc6-23888f945e77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU13190',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 313956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-12',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2008}
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU13190%27 HTTP/1.1" 200 None
2026-03-29 10:37:02 [auto1.de] INFO: Saving data for TU13190: {'auction_closing_time': 1774884413.0, 'created_time': 1773861494.215117, 'last_price_update_time': 1774780622.586312}
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU13190') HTTP/1.1" 204 0
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: EU26057
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: KN25796
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN25796%27 HTTP/1.1" 200 None
2026-03-29 10:37:02 [auto1.de] INFO: Scrape type for KN25796: 2
2026-03-29 10:37:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75f975dc-8b44-52be-b16b-bffcc2e9fdc1 with identifier: KN25796
2026-03-29 10:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75f975dc-8b44-52be-b16b-bffcc2e9fdc1 with scrape type 2
2026-03-29 10:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75f975dc-8b44-52be-b16b-bffcc2e9fdc1 with scrape type 2
2026-03-29 10:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75f975dc-8b44-52be-b16b-bffcc2e9fdc1, identifier: KN25796
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: VG12821
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: NW56335
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: EJ19003
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: EL19889
2026-03-29 10:37:02 [auto1.de] INFO: Found listing with ID: XC49831
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC49831%27 HTTP/1.1" 200 None
2026-03-29 10:37:02 [auto1.de] INFO: Scrape type for XC49831: 2
2026-03-29 10:37:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e022cecc-533f-554b-8306-a5bb992ae25c with identifier: XC49831
2026-03-29 10:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e022cecc-533f-554b-8306-a5bb992ae25c with scrape type 2
2026-03-29 10:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e022cecc-533f-554b-8306-a5bb992ae25c with scrape type 2
2026-03-29 10:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e022cecc-533f-554b-8306-a5bb992ae25c, identifier: XC49831
2026-03-29 10:37:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75f975dc-8b44-52be-b16b-bffcc2e9fdc1 with identifier: KN25796
2026-03-29 10:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75f975dc-8b44-52be-b16b-bffcc2e9fdc1 with identifier: KN25796
2026-03-29 10:37:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75f975dc-8b44-52be-b16b-bffcc2e9fdc1 with identifier: KN25796 to the API
2026-03-29 10:37:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:23:27Z',
 'fuel_type': 'diesel',
 'id': '75f975dc-8b44-52be-b16b-bffcc2e9fdc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN25796',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5',
 'odometer': 241999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-12',
 'seller_name': None,
 'title': 'Citroen C5 2.0 HDi Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2007}
2026-03-29 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN25796%27 HTTP/1.1" 200 None
2026-03-29 10:37:03 [auto1.de] INFO: Saving data for KN25796: {'auction_closing_time': 1774884207.0, 'created_time': 1774550867.726706, 'last_price_update_time': 1774780623.350528}
2026-03-29 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KN25796') HTTP/1.1" 204 0
2026-03-29 10:37:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e022cecc-533f-554b-8306-a5bb992ae25c with identifier: XC49831
2026-03-29 10:37:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e022cecc-533f-554b-8306-a5bb992ae25c with identifier: XC49831
2026-03-29 10:37:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e022cecc-533f-554b-8306-a5bb992ae25c with identifier: XC49831 to the API
2026-03-29 10:37:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:47:12Z',
 'fuel_type': 'diesel',
 'id': 'e022cecc-533f-554b-8306-a5bb992ae25c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC49831',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 293580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-03-31',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CDI Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2005}
2026-03-29 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC49831%27 HTTP/1.1" 200 None
2026-03-29 10:37:04 [auto1.de] INFO: Saving data for XC49831: {'auction_closing_time': 1774885632.0, 'created_time': 1774550883.934181, 'last_price_update_time': 1774780624.821807}
2026-03-29 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XC49831') HTTP/1.1" 204 0
2026-03-29 10:37:04 [auto1.de] INFO: Found listing with ID: NN77195
2026-03-29 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN77195%27 HTTP/1.1" 200 None
2026-03-29 10:37:04 [auto1.de] INFO: Scrape type for NN77195: 2
2026-03-29 10:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 342ab0f5-bd41-505f-9b2f-77f47ddea43a with identifier: NN77195
2026-03-29 10:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 342ab0f5-bd41-505f-9b2f-77f47ddea43a with scrape type 2
2026-03-29 10:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 342ab0f5-bd41-505f-9b2f-77f47ddea43a with scrape type 2
2026-03-29 10:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 342ab0f5-bd41-505f-9b2f-77f47ddea43a, identifier: NN77195
2026-03-29 10:37:04 [auto1.de] INFO: Found listing with ID: JG80760
2026-03-29 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG80760%27 HTTP/1.1" 200 None
2026-03-29 10:37:04 [auto1.de] INFO: Scrape type for JG80760: 2
2026-03-29 10:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8336b0ea-3ef9-5e89-9a74-e288e7fafc65 with identifier: JG80760
2026-03-29 10:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8336b0ea-3ef9-5e89-9a74-e288e7fafc65 with scrape type 2
2026-03-29 10:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8336b0ea-3ef9-5e89-9a74-e288e7fafc65 with scrape type 2
2026-03-29 10:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8336b0ea-3ef9-5e89-9a74-e288e7fafc65, identifier: JG80760
2026-03-29 10:37:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WW76911/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 342ab0f5-bd41-505f-9b2f-77f47ddea43a with identifier: NN77195
2026-03-29 10:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 342ab0f5-bd41-505f-9b2f-77f47ddea43a with identifier: NN77195
2026-03-29 10:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 342ab0f5-bd41-505f-9b2f-77f47ddea43a with identifier: NN77195 to the API
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:22:32Z',
 'fuel_type': 'petrol',
 'id': '342ab0f5-bd41-505f-9b2f-77f47ddea43a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN77195',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Picasso',
 'odometer': 106138,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-25',
 'seller_name': None,
 'title': 'Citroen C3 Picasso 1.2 PureTech Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2016}
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN77195%27 HTTP/1.1" 200 None
2026-03-29 10:37:05 [auto1.de] INFO: Saving data for NN77195: {'auction_closing_time': 1774884152.0, 'created_time': 1774463754.171343, 'last_price_update_time': 1774780625.525651}
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NN77195') HTTP/1.1" 204 0
2026-03-29 10:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8336b0ea-3ef9-5e89-9a74-e288e7fafc65 with identifier: JG80760
2026-03-29 10:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8336b0ea-3ef9-5e89-9a74-e288e7fafc65 with identifier: JG80760
2026-03-29 10:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8336b0ea-3ef9-5e89-9a74-e288e7fafc65 with identifier: JG80760 to the API
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:44:38Z',
 'fuel_type': 'diesel',
 'id': '8336b0ea-3ef9-5e89-9a74-e288e7fafc65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG80760',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 85631,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-08',
 'seller_name': None,
 'title': 'BMW X1 xDrive 20d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2018}
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG80760%27 HTTP/1.1" 200 None
2026-03-29 10:37:05 [auto1.de] INFO: Saving data for JG80760: {'auction_closing_time': 1774885478.0, 'created_time': 1774379238.735053, 'last_price_update_time': 1774780625.971783}
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG80760') HTTP/1.1" 204 0
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: RZ45087
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: HW35113
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: TP80753
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: WB48893
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: NF53472
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF53472%27 HTTP/1.1" 200 None
2026-03-29 10:37:06 [auto1.de] INFO: Scrape type for NF53472: 2
2026-03-29 10:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c81dd0c0-a2d5-5f20-9ba2-19fffe4dd2e8 with identifier: NF53472
2026-03-29 10:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c81dd0c0-a2d5-5f20-9ba2-19fffe4dd2e8 with scrape type 2
2026-03-29 10:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c81dd0c0-a2d5-5f20-9ba2-19fffe4dd2e8 with scrape type 2
2026-03-29 10:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c81dd0c0-a2d5-5f20-9ba2-19fffe4dd2e8, identifier: NF53472
2026-03-29 10:37:06 [auto1.de] INFO: Found listing with ID: TV16338
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV16338%27 HTTP/1.1" 200 None
2026-03-29 10:37:06 [auto1.de] INFO: Scrape type for TV16338: 2
2026-03-29 10:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 967f72b3-8576-5d55-bc0d-2495a5fb191a with identifier: TV16338
2026-03-29 10:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 967f72b3-8576-5d55-bc0d-2495a5fb191a with scrape type 2
2026-03-29 10:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 967f72b3-8576-5d55-bc0d-2495a5fb191a with scrape type 2
2026-03-29 10:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 967f72b3-8576-5d55-bc0d-2495a5fb191a, identifier: TV16338
2026-03-29 10:37:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YK45245> (referer: https://www.auto1.com/v1/car-details-view/YK45245/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UJ23150> (referer: https://www.auto1.com/v1/car-details-view/UJ23150/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c81dd0c0-a2d5-5f20-9ba2-19fffe4dd2e8 with identifier: NF53472
2026-03-29 10:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c81dd0c0-a2d5-5f20-9ba2-19fffe4dd2e8 with identifier: NF53472
2026-03-29 10:37:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c81dd0c0-a2d5-5f20-9ba2-19fffe4dd2e8 with identifier: NF53472 to the API
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:58:42Z',
 'fuel_type': 'diesel',
 'id': 'c81dd0c0-a2d5-5f20-9ba2-19fffe4dd2e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF53472',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 228749,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-15',
 'seller_name': None,
 'title': 'Ford S-Max 2.2 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2014}
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF53472%27 HTTP/1.1" 200 None
2026-03-29 10:37:06 [auto1.de] INFO: Saving data for NF53472: {'auction_closing_time': 1774886322.0, 'created_time': 1773517696.600579, 'last_price_update_time': 1774780626.725233}
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF53472') HTTP/1.1" 204 0
2026-03-29 10:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 967f72b3-8576-5d55-bc0d-2495a5fb191a with identifier: TV16338
2026-03-29 10:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 967f72b3-8576-5d55-bc0d-2495a5fb191a with identifier: TV16338
2026-03-29 10:37:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 967f72b3-8576-5d55-bc0d-2495a5fb191a with identifier: TV16338 to the API
2026-03-29 10:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:47:52Z',
 'fuel_type': 'petrol',
 'id': '967f72b3-8576-5d55-bc0d-2495a5fb191a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV16338',
 'listing': 'auction',
 'make': 'Subaru',
 'model': 'Legacy',
 'odometer': 162852,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-08-30',
 'seller_name': None,
 'title': 'Subaru Legacy 2.0 Hubertus Airbag',
 'transmission': 'manual',
 'trim': 'Hubertus Airbag',
 'year': 1998}
2026-03-29 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV16338%27 HTTP/1.1" 200 None
2026-03-29 10:37:07 [auto1.de] INFO: Saving data for TV16338: {'auction_closing_time': 1774885672.0, 'created_time': 1774378771.284447, 'last_price_update_time': 1774780627.945276}
2026-03-29 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV16338') HTTP/1.1" 204 0
2026-03-29 10:37:07 [auto1.de] INFO: Found listing with ID: AS89586
2026-03-29 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS89586%27 HTTP/1.1" 200 None
2026-03-29 10:37:07 [auto1.de] INFO: Scrape type for AS89586: 2
2026-03-29 10:37:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9c0c0d8-8b83-5be1-a127-570767a92bb0 with identifier: AS89586
2026-03-29 10:37:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9c0c0d8-8b83-5be1-a127-570767a92bb0 with scrape type 2
2026-03-29 10:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9c0c0d8-8b83-5be1-a127-570767a92bb0 with scrape type 2
2026-03-29 10:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9c0c0d8-8b83-5be1-a127-570767a92bb0, identifier: AS89586
2026-03-29 10:37:08 [scrapy.extensions.logstats] INFO: Crawled 61 pages (at 38 pages/min), scraped 179 items (at 91 items/min)
2026-03-29 10:37:08 [scrapy.extensions.memusage] INFO: Peak memory usage is 160MiB
2026-03-29 10:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9c0c0d8-8b83-5be1-a127-570767a92bb0 with identifier: AS89586
2026-03-29 10:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9c0c0d8-8b83-5be1-a127-570767a92bb0 with identifier: AS89586
2026-03-29 10:37:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9c0c0d8-8b83-5be1-a127-570767a92bb0 with identifier: AS89586 to the API
2026-03-29 10:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:17:08Z',
 'fuel_type': 'petrol',
 'id': 'f9c0c0d8-8b83-5be1-a127-570767a92bb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS89586',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 197175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-31',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.8 SX',
 'transmission': 'manual',
 'trim': 'SX',
 'year': 2007}
2026-03-29 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS89586%27 HTTP/1.1" 200 None
2026-03-29 10:37:08 [auto1.de] INFO: Saving data for AS89586: {'auction_closing_time': 1774883828.0, 'created_time': 1773688513.098673, 'last_price_update_time': 1774780628.546206}
2026-03-29 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AS89586') HTTP/1.1" 204 0
2026-03-29 10:37:08 [auto1.de] INFO: Found listing with ID: XL04777
2026-03-29 10:37:08 [auto1.de] INFO: Found listing with ID: ZB59540
2026-03-29 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB59540%27 HTTP/1.1" 200 None
2026-03-29 10:37:08 [auto1.de] INFO: Scrape type for ZB59540: 2
2026-03-29 10:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa1de6b0-58c9-57d7-9cb2-1068800d4ab2 with identifier: ZB59540
2026-03-29 10:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa1de6b0-58c9-57d7-9cb2-1068800d4ab2 with scrape type 2
2026-03-29 10:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa1de6b0-58c9-57d7-9cb2-1068800d4ab2 with scrape type 2
2026-03-29 10:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aa1de6b0-58c9-57d7-9cb2-1068800d4ab2, identifier: ZB59540
2026-03-29 10:37:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WL17880/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aa1de6b0-58c9-57d7-9cb2-1068800d4ab2 with identifier: ZB59540
2026-03-29 10:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aa1de6b0-58c9-57d7-9cb2-1068800d4ab2 with identifier: ZB59540
2026-03-29 10:37:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aa1de6b0-58c9-57d7-9cb2-1068800d4ab2 with identifier: ZB59540 to the API
2026-03-29 10:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-30T15:58:48Z',
 'fuel_type': 'petrol',
 'id': 'aa1de6b0-58c9-57d7-9cb2-1068800d4ab2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB59540',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 88106,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-28',
 'seller_name': None,
 'title': 'Renault Megane 1.2 TCe Energy Experience',
 'transmission': 'manual',
 'trim': 'Experience',
 'year': 2016}
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB59540%27 HTTP/1.1" 200 None
2026-03-29 10:37:09 [auto1.de] INFO: Saving data for ZB59540: {'auction_closing_time': 1774886328.0, 'created_time': 1773775806.362419, 'last_price_update_time': 1774780629.154999}
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZB59540') HTTP/1.1" 204 0
2026-03-29 10:37:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NY52199/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:09 [auto1.de] INFO: Channel: 24h | Page: 10 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f90e677a-2965-5862-8b51-7a0b52f336d1 with identifier: YK45245
2026-03-29 10:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f90e677a-2965-5862-8b51-7a0b52f336d1 with scrape type 1
2026-03-29 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f90e677a-2965-5862-8b51-7a0b52f336d1
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F7a%252F7f7a1f3829117c0658b723571c3a9e49%252Fpa%252FYK45245_e89b3e8e28aefb30947cb55afa7bd9a3.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/7a/7f7a1f3829117c0658b723571c3a9e49/pa/YK45245_e89b3e8e28aefb30947cb55afa7bd9a3.jpg already downloaded
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F7a%252F7f7a1f3829117c0658b723571c3a9e49%252Fpa%252FYK45245_bf8929dc4fa099a974b3686800599602.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/7a/7f7a1f3829117c0658b723571c3a9e49/pa/YK45245_bf8929dc4fa099a974b3686800599602.jpg already downloaded
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F7a%252F7f7a1f3829117c0658b723571c3a9e49%252Fpa%252FYK45245_9d9992b711a1038fe8590dc3bf4ab9f2.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/7a/7f7a1f3829117c0658b723571c3a9e49/pa/YK45245_9d9992b711a1038fe8590dc3bf4ab9f2.jpg already downloaded
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F7a%252F7f7a1f3829117c0658b723571c3a9e49%252Fpa%252FYK45245_0aebe5a6164b6c987f2cadfae12ac8e2.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/7a/7f7a1f3829117c0658b723571c3a9e49/pa/YK45245_0aebe5a6164b6c987f2cadfae12ac8e2.jpg already downloaded
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F7a%252F7f7a1f3829117c0658b723571c3a9e49%252Fpa%252FYK45245_5e1bea5bcf602a3bbcc3c2e37a117e82.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/7a/7f7a1f3829117c0658b723571c3a9e49/pa/YK45245_5e1bea5bcf602a3bbcc3c2e37a117e82.jpg already downloaded
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F7a%252F7f7a1f3829117c0658b723571c3a9e49%252Fpa%252FYK45245_a60589d38d9fbcac669bb00893bb07a1.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/7a/7f7a1f3829117c0658b723571c3a9e49/pa/YK45245_a60589d38d9fbcac669bb00893bb07a1.jpg already downloaded
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F7a%252F7f7a1f3829117c0658b723571c3a9e49%252Fpa%252FYK45245_acc38dd3f339f38f3a9223d3a2cac006.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/7a/7f7a1f3829117c0658b723571c3a9e49/pa/YK45245_acc38dd3f339f38f3a9223d3a2cac006.jpg already downloaded
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F7a%252F7f7a1f3829117c0658b723571c3a9e49%252Fpa%252FYK45245_a81cd1decba708746fd5c349073ca4b4.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/7a/7f7a1f3829117c0658b723571c3a9e49/pa/YK45245_a81cd1decba708746fd5c349073ca4b4.jpg already downloaded
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F7a%252F7f7a1f3829117c0658b723571c3a9e49%252Fpa%252FYK45245_600875bf123f5886f6734321c542490a.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/7a/7f7a1f3829117c0658b723571c3a9e49/pa/YK45245_600875bf123f5886f6734321c542490a.jpg already downloaded
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F7a%252F7f7a1f3829117c0658b723571c3a9e49%252Fpa%252FYK45245_8edaee4ba3e687dd42976574f0ecc7d5.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/7a/7f7a1f3829117c0658b723571c3a9e49/pa/YK45245_8edaee4ba3e687dd42976574f0ecc7d5.jpg already downloaded
2026-03-29 10:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f90e677a-2965-5862-8b51-7a0b52f336d1, identifier: YK45245
2026-03-29 10:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbb50f2c-1443-59fb-b8d5-2da0e8a81b93 with identifier: UJ23150
2026-03-29 10:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbb50f2c-1443-59fb-b8d5-2da0e8a81b93 with scrape type 1
2026-03-29 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fbb50f2c-1443-59fb-b8d5-2da0e8a81b93
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F89%252F1689e0b213d9f5f4a3a193630205cfc8%252Fpa%252FUJ23150_a08fd04b19d534ee949abae45c6ac831.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/89/1689e0b213d9f5f4a3a193630205cfc8/pa/UJ23150_a08fd04b19d534ee949abae45c6ac831.jpg already downloaded
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F89%252F1689e0b213d9f5f4a3a193630205cfc8%252Fpa%252FUJ23150_1a5ddddd40f580b894b4dbd43879d86f.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/89/1689e0b213d9f5f4a3a193630205cfc8/pa/UJ23150_1a5ddddd40f580b894b4dbd43879d86f.jpg already downloaded
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F89%252F1689e0b213d9f5f4a3a193630205cfc8%252Fpa%252FUJ23150_181cb57cc99ef891550fbdbaab6f1cac.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/89/1689e0b213d9f5f4a3a193630205cfc8/pa/UJ23150_181cb57cc99ef891550fbdbaab6f1cac.jpg already downloaded
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F89%252F1689e0b213d9f5f4a3a193630205cfc8%252Fpa%252FUJ23150_36611b6a6b10a0a2592b00f20cf2b484.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/89/1689e0b213d9f5f4a3a193630205cfc8/pa/UJ23150_36611b6a6b10a0a2592b00f20cf2b484.jpg already downloaded
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F89%252F1689e0b213d9f5f4a3a193630205cfc8%252Fpa%252FUJ23150_fcf18a214eed5214d2ee1bc8f3e8f2e6.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/89/1689e0b213d9f5f4a3a193630205cfc8/pa/UJ23150_fcf18a214eed5214d2ee1bc8f3e8f2e6.jpg already downloaded
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F89%252F1689e0b213d9f5f4a3a193630205cfc8%252Fpa%252FUJ23150_595189ab036ca2d63a25ff2ebe060874.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/89/1689e0b213d9f5f4a3a193630205cfc8/pa/UJ23150_595189ab036ca2d63a25ff2ebe060874.jpg already downloaded
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F89%252F1689e0b213d9f5f4a3a193630205cfc8%252Fpa%252FUJ23150_afeddc07bae946785710b8b478833c4e.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/89/1689e0b213d9f5f4a3a193630205cfc8/pa/UJ23150_afeddc07bae946785710b8b478833c4e.jpg already downloaded
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F89%252F1689e0b213d9f5f4a3a193630205cfc8%252Fpa%252FUJ23150_e2fa971a6b12d60442b2b9884893d2a2.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/89/1689e0b213d9f5f4a3a193630205cfc8/pa/UJ23150_e2fa971a6b12d60442b2b9884893d2a2.jpg already downloaded
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F89%252F1689e0b213d9f5f4a3a193630205cfc8%252Fpa%252FUJ23150_adfd1330235a423d6d866ef5171ec617.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/89/1689e0b213d9f5f4a3a193630205cfc8/pa/UJ23150_adfd1330235a423d6d866ef5171ec617.jpg already downloaded
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252F89%252F1689e0b213d9f5f4a3a193630205cfc8%252Fpa%252FUJ23150_c964fc525c7c16e48ebdd9508f1e1bfa.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/89/1689e0b213d9f5f4a3a193630205cfc8/pa/UJ23150_c964fc525c7c16e48ebdd9508f1e1bfa.jpg already downloaded
2026-03-29 10:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fbb50f2c-1443-59fb-b8d5-2da0e8a81b93, identifier: UJ23150
2026-03-29 10:37:09 [auto1.de] INFO: Found listing with ID: EZ65040
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ65040%27 HTTP/1.1" 200 None
2026-03-29 10:37:09 [auto1.de] INFO: Scrape type for EZ65040: 2
2026-03-29 10:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b041abaa-e91e-5fe2-ba8b-c8602a23071d with identifier: EZ65040
2026-03-29 10:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b041abaa-e91e-5fe2-ba8b-c8602a23071d with scrape type 2
2026-03-29 10:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b041abaa-e91e-5fe2-ba8b-c8602a23071d with scrape type 2
2026-03-29 10:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b041abaa-e91e-5fe2-ba8b-c8602a23071d, identifier: EZ65040
2026-03-29 10:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f90e677a-2965-5862-8b51-7a0b52f336d1 with identifier: YK45245
2026-03-29 10:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f90e677a-2965-5862-8b51-7a0b52f336d1 with identifier: YK45245
2026-03-29 10:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f90e677a-2965-5862-8b51-7a0b52f336d1 with identifier: YK45245 to the API
2026-03-29 10:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YK45245>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:59:59Z',
 'fuel_type': 'diesel',
 'id': 'f90e677a-2965-5862-8b51-7a0b52f336d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK45245',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 115098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img7f/7a/7f7a1f3829117c0658b723571c3a9e49/pa/YK45245_e89b3e8e28aefb30947cb55afa7bd9a3.jpg',
                'https://img-pa.auto1.com/img7f/7a/7f7a1f3829117c0658b723571c3a9e49/pa/YK45245_bf8929dc4fa099a974b3686800599602.jpg',
                'https://img-pa.auto1.com/img7f/7a/7f7a1f3829117c0658b723571c3a9e49/pa/YK45245_9d9992b711a1038fe8590dc3bf4ab9f2.jpg',
                'https://img-pa.auto1.com/img7f/7a/7f7a1f3829117c0658b723571c3a9e49/pa/YK45245_0aebe5a6164b6c987f2cadfae12ac8e2.jpg',
                'https://img-pa.auto1.com/img7f/7a/7f7a1f3829117c0658b723571c3a9e49/pa/YK45245_5e1bea5bcf602a3bbcc3c2e37a117e82.jpg',
                'https://img-pa.auto1.com/img7f/7a/7f7a1f3829117c0658b723571c3a9e49/pa/YK45245_a60589d38d9fbcac669bb00893bb07a1.jpg',
                'https://img-pa.auto1.com/img7f/7a/7f7a1f3829117c0658b723571c3a9e49/pa/YK45245_acc38dd3f339f38f3a9223d3a2cac006.jpg',
                'https://img-pa.auto1.com/img7f/7a/7f7a1f3829117c0658b723571c3a9e49/pa/YK45245_a81cd1decba708746fd5c349073ca4b4.jpg',
                'https://img-pa.auto1.com/img7f/7a/7f7a1f3829117c0658b723571c3a9e49/pa/YK45245_600875bf123f5886f6734321c542490a.jpg',
                'https://img-pa.auto1.com/img7f/7a/7f7a1f3829117c0658b723571c3a9e49/pa/YK45245_8edaee4ba3e687dd42976574f0ecc7d5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f90e677a-2965-5862-8b51-7a0b52f336d1/f90e677a-2965-5862-8b51-7a0b52f336d1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74805,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/7a/7f7a1f3829117c0658b723571c3a9e49/pa/YK45245_e89b3e8e28aefb30947cb55afa7bd9a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f90e677a-2965-5862-8b51-7a0b52f336d1/f90e677a-2965-5862-8b51-7a0b52f336d1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/7a/7f7a1f3829117c0658b723571c3a9e49/pa/YK45245_bf8929dc4fa099a974b3686800599602.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f90e677a-2965-5862-8b51-7a0b52f336d1/f90e677a-2965-5862-8b51-7a0b52f336d1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/7a/7f7a1f3829117c0658b723571c3a9e49/pa/YK45245_9d9992b711a1038fe8590dc3bf4ab9f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f90e677a-2965-5862-8b51-7a0b52f336d1/f90e677a-2965-5862-8b51-7a0b52f336d1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/7a/7f7a1f3829117c0658b723571c3a9e49/pa/YK45245_0aebe5a6164b6c987f2cadfae12ac8e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f90e677a-2965-5862-8b51-7a0b52f336d1/f90e677a-2965-5862-8b51-7a0b52f336d1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52771,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/7a/7f7a1f3829117c0658b723571c3a9e49/pa/YK45245_5e1bea5bcf602a3bbcc3c2e37a117e82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f90e677a-2965-5862-8b51-7a0b52f336d1/f90e677a-2965-5862-8b51-7a0b52f336d1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64556,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/7a/7f7a1f3829117c0658b723571c3a9e49/pa/YK45245_a60589d38d9fbcac669bb00893bb07a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f90e677a-2965-5862-8b51-7a0b52f336d1/f90e677a-2965-5862-8b51-7a0b52f336d1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/7a/7f7a1f3829117c0658b723571c3a9e49/pa/YK45245_acc38dd3f339f38f3a9223d3a2cac006.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f90e677a-2965-5862-8b51-7a0b52f336d1/f90e677a-2965-5862-8b51-7a0b52f336d1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/7a/7f7a1f3829117c0658b723571c3a9e49/pa/YK45245_a81cd1decba708746fd5c349073ca4b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f90e677a-2965-5862-8b51-7a0b52f336d1/f90e677a-2965-5862-8b51-7a0b52f336d1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/7a/7f7a1f3829117c0658b723571c3a9e49/pa/YK45245_600875bf123f5886f6734321c542490a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f90e677a-2965-5862-8b51-7a0b52f336d1/f90e677a-2965-5862-8b51-7a0b52f336d1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/7a/7f7a1f3829117c0658b723571c3a9e49/pa/YK45245_8edaee4ba3e687dd42976574f0ecc7d5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Sd4 HSE Dynamic',
 'transmission': 'automatic',
 'trim': 'HSE Dynamic',
 'year': 2015}
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK45245%27 HTTP/1.1" 200 None
2026-03-29 10:37:11 [auto1.de] INFO: Saving data for YK45245: {'created_time': 1774780631.348594, 'last_price_update_time': 1774780631.348607, 'auction_closing_time': 1774886399.0}
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YK45245') HTTP/1.1" 204 0
2026-03-29 10:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fbb50f2c-1443-59fb-b8d5-2da0e8a81b93 with identifier: UJ23150
2026-03-29 10:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fbb50f2c-1443-59fb-b8d5-2da0e8a81b93 with identifier: UJ23150
2026-03-29 10:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fbb50f2c-1443-59fb-b8d5-2da0e8a81b93 with identifier: UJ23150 to the API
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UJ23150>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:28:24Z',
 'fuel_type': 'petrol',
 'id': 'fbb50f2c-1443-59fb-b8d5-2da0e8a81b93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ23150',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse Limousine',
 'odometer': 29946,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img16/89/1689e0b213d9f5f4a3a193630205cfc8/pa/UJ23150_a08fd04b19d534ee949abae45c6ac831.jpg',
                'https://img-pa.auto1.com/img16/89/1689e0b213d9f5f4a3a193630205cfc8/pa/UJ23150_1a5ddddd40f580b894b4dbd43879d86f.jpg',
                'https://img-pa.auto1.com/img16/89/1689e0b213d9f5f4a3a193630205cfc8/pa/UJ23150_181cb57cc99ef891550fbdbaab6f1cac.jpg',
                'https://img-pa.auto1.com/img16/89/1689e0b213d9f5f4a3a193630205cfc8/pa/UJ23150_36611b6a6b10a0a2592b00f20cf2b484.jpg',
                'https://img-pa.auto1.com/img16/89/1689e0b213d9f5f4a3a193630205cfc8/pa/UJ23150_fcf18a214eed5214d2ee1bc8f3e8f2e6.jpg',
                'https://img-pa.auto1.com/img16/89/1689e0b213d9f5f4a3a193630205cfc8/pa/UJ23150_595189ab036ca2d63a25ff2ebe060874.jpg',
                'https://img-pa.auto1.com/img16/89/1689e0b213d9f5f4a3a193630205cfc8/pa/UJ23150_afeddc07bae946785710b8b478833c4e.jpg',
                'https://img-pa.auto1.com/img16/89/1689e0b213d9f5f4a3a193630205cfc8/pa/UJ23150_e2fa971a6b12d60442b2b9884893d2a2.jpg',
                'https://img-pa.auto1.com/img16/89/1689e0b213d9f5f4a3a193630205cfc8/pa/UJ23150_adfd1330235a423d6d866ef5171ec617.jpg',
                'https://img-pa.auto1.com/img16/89/1689e0b213d9f5f4a3a193630205cfc8/pa/UJ23150_c964fc525c7c16e48ebdd9508f1e1bfa.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbb50f2c-1443-59fb-b8d5-2da0e8a81b93/fbb50f2c-1443-59fb-b8d5-2da0e8a81b93_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/89/1689e0b213d9f5f4a3a193630205cfc8/pa/UJ23150_a08fd04b19d534ee949abae45c6ac831.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbb50f2c-1443-59fb-b8d5-2da0e8a81b93/fbb50f2c-1443-59fb-b8d5-2da0e8a81b93_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/89/1689e0b213d9f5f4a3a193630205cfc8/pa/UJ23150_1a5ddddd40f580b894b4dbd43879d86f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbb50f2c-1443-59fb-b8d5-2da0e8a81b93/fbb50f2c-1443-59fb-b8d5-2da0e8a81b93_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/89/1689e0b213d9f5f4a3a193630205cfc8/pa/UJ23150_181cb57cc99ef891550fbdbaab6f1cac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbb50f2c-1443-59fb-b8d5-2da0e8a81b93/fbb50f2c-1443-59fb-b8d5-2da0e8a81b93_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/89/1689e0b213d9f5f4a3a193630205cfc8/pa/UJ23150_36611b6a6b10a0a2592b00f20cf2b484.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbb50f2c-1443-59fb-b8d5-2da0e8a81b93/fbb50f2c-1443-59fb-b8d5-2da0e8a81b93_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/89/1689e0b213d9f5f4a3a193630205cfc8/pa/UJ23150_fcf18a214eed5214d2ee1bc8f3e8f2e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbb50f2c-1443-59fb-b8d5-2da0e8a81b93/fbb50f2c-1443-59fb-b8d5-2da0e8a81b93_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/89/1689e0b213d9f5f4a3a193630205cfc8/pa/UJ23150_595189ab036ca2d63a25ff2ebe060874.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbb50f2c-1443-59fb-b8d5-2da0e8a81b93/fbb50f2c-1443-59fb-b8d5-2da0e8a81b93_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/89/1689e0b213d9f5f4a3a193630205cfc8/pa/UJ23150_afeddc07bae946785710b8b478833c4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbb50f2c-1443-59fb-b8d5-2da0e8a81b93/fbb50f2c-1443-59fb-b8d5-2da0e8a81b93_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/89/1689e0b213d9f5f4a3a193630205cfc8/pa/UJ23150_e2fa971a6b12d60442b2b9884893d2a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbb50f2c-1443-59fb-b8d5-2da0e8a81b93/fbb50f2c-1443-59fb-b8d5-2da0e8a81b93_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/89/1689e0b213d9f5f4a3a193630205cfc8/pa/UJ23150_adfd1330235a423d6d866ef5171ec617.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbb50f2c-1443-59fb-b8d5-2da0e8a81b93/fbb50f2c-1443-59fb-b8d5-2da0e8a81b93_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70319,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/89/1689e0b213d9f5f4a3a193630205cfc8/pa/UJ23150_c964fc525c7c16e48ebdd9508f1e1bfa.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse Limousine A 200 Mild-Hybrid AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2023}
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ23150%27 HTTP/1.1" 200 None
2026-03-29 10:37:11 [auto1.de] INFO: Saving data for UJ23150: {'created_time': 1774780631.868296, 'last_price_update_time': 1774780631.868307, 'auction_closing_time': 1774884504.0}
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ23150') HTTP/1.1" 204 0
2026-03-29 10:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b041abaa-e91e-5fe2-ba8b-c8602a23071d with identifier: EZ65040
2026-03-29 10:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b041abaa-e91e-5fe2-ba8b-c8602a23071d with identifier: EZ65040
2026-03-29 10:37:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b041abaa-e91e-5fe2-ba8b-c8602a23071d with identifier: EZ65040 to the API
2026-03-29 10:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:57:36Z',
 'fuel_type': 'petrol',
 'id': 'b041abaa-e91e-5fe2-ba8b-c8602a23071d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ65040',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 51710,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-05',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.5 TSI ACT Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2019}
2026-03-29 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ65040%27 HTTP/1.1" 200 None
2026-03-29 10:37:12 [auto1.de] INFO: Saving data for EZ65040: {'auction_closing_time': 1774886256.0, 'created_time': 1773775856.706354, 'last_price_update_time': 1774780632.329506}
2026-03-29 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ65040') HTTP/1.1" 204 0
2026-03-29 10:37:12 [auto1.de] INFO: Found listing with ID: TJ95012
2026-03-29 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ95012%27 HTTP/1.1" 200 None
2026-03-29 10:37:12 [auto1.de] INFO: Scrape type for TJ95012: 2
2026-03-29 10:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52f82dd4-9620-581d-be9c-066eeddbe951 with identifier: TJ95012
2026-03-29 10:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52f82dd4-9620-581d-be9c-066eeddbe951 with scrape type 2
2026-03-29 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52f82dd4-9620-581d-be9c-066eeddbe951 with scrape type 2
2026-03-29 10:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52f82dd4-9620-581d-be9c-066eeddbe951, identifier: TJ95012
2026-03-29 10:37:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:12 [auto1.de] INFO: Found listing with ID: KR07785
2026-03-29 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR07785%27 HTTP/1.1" 200 None
2026-03-29 10:37:12 [auto1.de] INFO: Scrape type for KR07785: 2
2026-03-29 10:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b03f4cdd-367a-5493-8bda-ce6b24d12ff4 with identifier: KR07785
2026-03-29 10:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b03f4cdd-367a-5493-8bda-ce6b24d12ff4 with scrape type 2
2026-03-29 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b03f4cdd-367a-5493-8bda-ce6b24d12ff4 with scrape type 2
2026-03-29 10:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b03f4cdd-367a-5493-8bda-ce6b24d12ff4, identifier: KR07785
2026-03-29 10:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52f82dd4-9620-581d-be9c-066eeddbe951 with identifier: TJ95012
2026-03-29 10:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52f82dd4-9620-581d-be9c-066eeddbe951 with identifier: TJ95012
2026-03-29 10:37:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52f82dd4-9620-581d-be9c-066eeddbe951 with identifier: TJ95012 to the API
2026-03-29 10:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 129,
 'expiration_date': '2026-03-30T15:20:12Z',
 'fuel_type': 'petrol',
 'id': '52f82dd4-9620-581d-be9c-066eeddbe951',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ95012',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 26244,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-26',
 'seller_name': None,
 'title': 'Suzuki Swift 1.4 BoosterJet Mild-Hybrid Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2022}
2026-03-29 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ95012%27 HTTP/1.1" 200 None
2026-03-29 10:37:12 [auto1.de] INFO: Saving data for TJ95012: {'auction_closing_time': 1774884012.0, 'created_time': 1773774797.258653, 'last_price_update_time': 1774780632.931875}
2026-03-29 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ95012') HTTP/1.1" 204 0
2026-03-29 10:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZV78302> (referer: https://www.auto1.com/v1/car-details-view/ZV78302/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VT21239> (referer: https://www.auto1.com/v1/car-details-view/VT21239/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b03f4cdd-367a-5493-8bda-ce6b24d12ff4 with identifier: KR07785
2026-03-29 10:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b03f4cdd-367a-5493-8bda-ce6b24d12ff4 with identifier: KR07785
2026-03-29 10:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b03f4cdd-367a-5493-8bda-ce6b24d12ff4 with identifier: KR07785 to the API
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 158,
 'expiration_date': '2026-03-30T15:28:36Z',
 'fuel_type': 'petrol',
 'id': 'b03f4cdd-367a-5493-8bda-ce6b24d12ff4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR07785',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 56973,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-17',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T Zama',
 'transmission': 'automatic',
 'trim': 'Zama',
 'year': 2021}
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR07785%27 HTTP/1.1" 200 None
2026-03-29 10:37:13 [auto1.de] INFO: Saving data for KR07785: {'auction_closing_time': 1774884516.0, 'created_time': 1774379578.767395, 'last_price_update_time': 1774780633.288109}
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR07785') HTTP/1.1" 204 0
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: BB55573
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB55573%27 HTTP/1.1" 200 None
2026-03-29 10:37:13 [auto1.de] INFO: Scrape type for BB55573: 2
2026-03-29 10:37:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6f7aa36-3cd0-5722-9b37-932c90170c80 with identifier: BB55573
2026-03-29 10:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6f7aa36-3cd0-5722-9b37-932c90170c80 with scrape type 2
2026-03-29 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6f7aa36-3cd0-5722-9b37-932c90170c80 with scrape type 2
2026-03-29 10:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6f7aa36-3cd0-5722-9b37-932c90170c80, identifier: BB55573
2026-03-29 10:37:13 [auto1.de] INFO: Found listing with ID: CW58984
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW58984%27 HTTP/1.1" 200 None
2026-03-29 10:37:13 [auto1.de] INFO: Scrape type for CW58984: 2
2026-03-29 10:37:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d37d51a0-adf9-5ab4-be3d-9b59ff563204 with identifier: CW58984
2026-03-29 10:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d37d51a0-adf9-5ab4-be3d-9b59ff563204 with scrape type 2
2026-03-29 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d37d51a0-adf9-5ab4-be3d-9b59ff563204 with scrape type 2
2026-03-29 10:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d37d51a0-adf9-5ab4-be3d-9b59ff563204, identifier: CW58984
2026-03-29 10:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6f7aa36-3cd0-5722-9b37-932c90170c80 with identifier: BB55573
2026-03-29 10:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6f7aa36-3cd0-5722-9b37-932c90170c80 with identifier: BB55573
2026-03-29 10:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6f7aa36-3cd0-5722-9b37-932c90170c80 with identifier: BB55573 to the API
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:29:31Z',
 'fuel_type': 'petrol',
 'id': 'a6f7aa36-3cd0-5722-9b37-932c90170c80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB55573',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 97774,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-04-07',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Edition Bild',
 'transmission': 'manual',
 'trim': 'Edition Bild',
 'year': 2003}
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB55573%27 HTTP/1.1" 200 None
2026-03-29 10:37:13 [auto1.de] INFO: Saving data for BB55573: {'auction_closing_time': 1774884571.0, 'created_time': 1774638488.273313, 'last_price_update_time': 1774780633.890557}
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB55573') HTTP/1.1" 204 0
2026-03-29 10:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d37d51a0-adf9-5ab4-be3d-9b59ff563204 with identifier: CW58984
2026-03-29 10:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d37d51a0-adf9-5ab4-be3d-9b59ff563204 with identifier: CW58984
2026-03-29 10:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d37d51a0-adf9-5ab4-be3d-9b59ff563204 with identifier: CW58984 to the API
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:23:49Z',
 'fuel_type': 'petrol',
 'id': 'd37d51a0-adf9-5ab4-be3d-9b59ff563204',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW58984',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 206719,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-28',
 'seller_name': None,
 'title': 'Ford Focus 1.8 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2007}
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW58984%27 HTTP/1.1" 200 None
2026-03-29 10:37:14 [auto1.de] INFO: Saving data for CW58984: {'auction_closing_time': 1774884229.0, 'created_time': 1773861654.207414, 'last_price_update_time': 1774780634.230245}
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW58984') HTTP/1.1" 204 0
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: UA53606
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA53606%27 HTTP/1.1" 200 None
2026-03-29 10:37:14 [auto1.de] INFO: Scrape type for UA53606: 2
2026-03-29 10:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66c6f3a8-2a8a-5706-bd72-62f033ee70e5 with identifier: UA53606
2026-03-29 10:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66c6f3a8-2a8a-5706-bd72-62f033ee70e5 with scrape type 2
2026-03-29 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66c6f3a8-2a8a-5706-bd72-62f033ee70e5 with scrape type 2
2026-03-29 10:37:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66c6f3a8-2a8a-5706-bd72-62f033ee70e5, identifier: UA53606
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: LE60252
2026-03-29 10:37:14 [auto1.de] INFO: Found listing with ID: ZF51547
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF51547%27 HTTP/1.1" 200 None
2026-03-29 10:37:14 [auto1.de] INFO: Scrape type for ZF51547: 2
2026-03-29 10:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65d2cf42-3356-5394-b36e-6b2cebfde13a with identifier: ZF51547
2026-03-29 10:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65d2cf42-3356-5394-b36e-6b2cebfde13a with scrape type 2
2026-03-29 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65d2cf42-3356-5394-b36e-6b2cebfde13a with scrape type 2
2026-03-29 10:37:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65d2cf42-3356-5394-b36e-6b2cebfde13a, identifier: ZF51547
2026-03-29 10:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66c6f3a8-2a8a-5706-bd72-62f033ee70e5 with identifier: UA53606
2026-03-29 10:37:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66c6f3a8-2a8a-5706-bd72-62f033ee70e5 with identifier: UA53606
2026-03-29 10:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66c6f3a8-2a8a-5706-bd72-62f033ee70e5 with identifier: UA53606 to the API
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:11:26Z',
 'fuel_type': 'petrol',
 'id': '66c6f3a8-2a8a-5706-bd72-62f033ee70e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA53606',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 151766,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-21',
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 Aktionsmodell',
 'transmission': 'manual',
 'trim': 'Aktionsmodell',
 'year': 2016}
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA53606%27 HTTP/1.1" 200 None
2026-03-29 10:37:14 [auto1.de] INFO: Saving data for UA53606: {'auction_closing_time': 1774883486.0, 'created_time': 1773516447.717427, 'last_price_update_time': 1774780634.823121}
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA53606') HTTP/1.1" 204 0
2026-03-29 10:37:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf3098e4-d57f-54a3-a3da-be138a881f52 with identifier: ZV78302
2026-03-29 10:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf3098e4-d57f-54a3-a3da-be138a881f52 with scrape type 1
2026-03-29 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bf3098e4-d57f-54a3-a3da-be138a881f52
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F05%252F81055e155505bb31133589885385bf3b%252Fpa%252FZV78302_8e118e85cccf76b43d4bdc2927de0867.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/05/81055e155505bb31133589885385bf3b/pa/ZV78302_8e118e85cccf76b43d4bdc2927de0867.jpg already downloaded
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F05%252F81055e155505bb31133589885385bf3b%252Fpa%252FZV78302_c3784f16c64421136615c3bee452e900.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/05/81055e155505bb31133589885385bf3b/pa/ZV78302_c3784f16c64421136615c3bee452e900.jpg already downloaded
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F05%252F81055e155505bb31133589885385bf3b%252Fpa%252FZV78302_7ec08145cf176f7f9268b2dde74ee433.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/05/81055e155505bb31133589885385bf3b/pa/ZV78302_7ec08145cf176f7f9268b2dde74ee433.jpg already downloaded
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F05%252F81055e155505bb31133589885385bf3b%252Fpa%252FZV78302_abfc10279d93bf317a0c9268f92305f6.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/05/81055e155505bb31133589885385bf3b/pa/ZV78302_abfc10279d93bf317a0c9268f92305f6.jpg already downloaded
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F05%252F81055e155505bb31133589885385bf3b%252Fpa%252FZV78302_7613961bf802e9348d9e7238a7151b14.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/05/81055e155505bb31133589885385bf3b/pa/ZV78302_7613961bf802e9348d9e7238a7151b14.jpg already downloaded
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F05%252F81055e155505bb31133589885385bf3b%252Fpa%252FZV78302_383587b2ab5da926731ad0597d08d0da.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/05/81055e155505bb31133589885385bf3b/pa/ZV78302_383587b2ab5da926731ad0597d08d0da.jpg already downloaded
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F05%252F81055e155505bb31133589885385bf3b%252Fpa%252FZV78302_0e0e71e6b8d919773d930efa61e2c196.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/05/81055e155505bb31133589885385bf3b/pa/ZV78302_0e0e71e6b8d919773d930efa61e2c196.jpg already downloaded
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F05%252F81055e155505bb31133589885385bf3b%252Fpa%252FZV78302_8593dad73f631323e7b8cd4e15f4c460.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/05/81055e155505bb31133589885385bf3b/pa/ZV78302_8593dad73f631323e7b8cd4e15f4c460.jpg already downloaded
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F05%252F81055e155505bb31133589885385bf3b%252Fpa%252FZV78302_478b635a2e0c5143bab68c52a745ccce.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/05/81055e155505bb31133589885385bf3b/pa/ZV78302_478b635a2e0c5143bab68c52a745ccce.jpg already downloaded
2026-03-29 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252F05%252F81055e155505bb31133589885385bf3b%252Fpa%252FZV78302_4c79b7489e29da2bc9303ade885377bb.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/05/81055e155505bb31133589885385bf3b/pa/ZV78302_4c79b7489e29da2bc9303ade885377bb.jpg already downloaded
2026-03-29 10:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bf3098e4-d57f-54a3-a3da-be138a881f52, identifier: ZV78302
2026-03-29 10:37:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04b8cb32-6b71-5de2-a373-3f2258b156c7 with identifier: VT21239
2026-03-29 10:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04b8cb32-6b71-5de2-a373-3f2258b156c7 with scrape type 1
2026-03-29 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 04b8cb32-6b71-5de2-a373-3f2258b156c7
2026-03-29 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F31%252F47312df36932a338ca1036b0cc031acf%252Fpa%252FVT21239_0fc03d5ac3300ca876f71b45029b5749.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/31/47312df36932a338ca1036b0cc031acf/pa/VT21239_0fc03d5ac3300ca876f71b45029b5749.jpg already downloaded
2026-03-29 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F31%252F47312df36932a338ca1036b0cc031acf%252Fpa%252FVT21239_dcf3d7d2fbe77636ef31b4fe767e412a.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/31/47312df36932a338ca1036b0cc031acf/pa/VT21239_dcf3d7d2fbe77636ef31b4fe767e412a.jpg already downloaded
2026-03-29 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F31%252F47312df36932a338ca1036b0cc031acf%252Fpa%252FVT21239_3951d14df01d7f0acbdcf9acff1832c8.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/31/47312df36932a338ca1036b0cc031acf/pa/VT21239_3951d14df01d7f0acbdcf9acff1832c8.jpg already downloaded
2026-03-29 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F31%252F47312df36932a338ca1036b0cc031acf%252Fpa%252FVT21239_3a95a0f8726226d263c33e4832647bf1.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/31/47312df36932a338ca1036b0cc031acf/pa/VT21239_3a95a0f8726226d263c33e4832647bf1.jpg already downloaded
2026-03-29 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F31%252F47312df36932a338ca1036b0cc031acf%252Fpa%252FVT21239_232447272d8ff4c018d7cf1c0b74fd54.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/31/47312df36932a338ca1036b0cc031acf/pa/VT21239_232447272d8ff4c018d7cf1c0b74fd54.jpg already downloaded
2026-03-29 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F31%252F47312df36932a338ca1036b0cc031acf%252Fpa%252FVT21239_a9cb402e96448ea12a947aa25f4d6c09.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/31/47312df36932a338ca1036b0cc031acf/pa/VT21239_a9cb402e96448ea12a947aa25f4d6c09.jpg already downloaded
2026-03-29 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F31%252F47312df36932a338ca1036b0cc031acf%252Fpa%252FVT21239_86dc62d4be9c14a4cfc56c9b723da974.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/31/47312df36932a338ca1036b0cc031acf/pa/VT21239_86dc62d4be9c14a4cfc56c9b723da974.jpg already downloaded
2026-03-29 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F31%252F47312df36932a338ca1036b0cc031acf%252Fpa%252FVT21239_3219e026a4dccb958bd78d80b52740af.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/31/47312df36932a338ca1036b0cc031acf/pa/VT21239_3219e026a4dccb958bd78d80b52740af.jpg already downloaded
2026-03-29 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F31%252F47312df36932a338ca1036b0cc031acf%252Fpa%252FVT21239_69a773679a884b646a48873edd80b100.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/31/47312df36932a338ca1036b0cc031acf/pa/VT21239_69a773679a884b646a48873edd80b100.jpg already downloaded
2026-03-29 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F31%252F47312df36932a338ca1036b0cc031acf%252Fpa%252FVT21239_f3c9c6eb7b723609b45d7b7fc284a53f.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/31/47312df36932a338ca1036b0cc031acf/pa/VT21239_f3c9c6eb7b723609b45d7b7fc284a53f.jpg already downloaded
2026-03-29 10:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 04b8cb32-6b71-5de2-a373-3f2258b156c7, identifier: VT21239
2026-03-29 10:37:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65d2cf42-3356-5394-b36e-6b2cebfde13a with identifier: ZF51547
2026-03-29 10:37:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65d2cf42-3356-5394-b36e-6b2cebfde13a with identifier: ZF51547
2026-03-29 10:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65d2cf42-3356-5394-b36e-6b2cebfde13a with identifier: ZF51547 to the API
2026-03-29 10:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:58:49Z',
 'fuel_type': 'petrol',
 'id': '65d2cf42-3356-5394-b36e-6b2cebfde13a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF51547',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 155053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-27',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2012}
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF51547%27 HTTP/1.1" 200 None
2026-03-29 10:37:16 [auto1.de] INFO: Saving data for ZF51547: {'auction_closing_time': 1774886329.0, 'created_time': 1773571706.098878, 'last_price_update_time': 1774780636.041751}
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZF51547') HTTP/1.1" 204 0
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: AE82588
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE82588%27 HTTP/1.1" 200 None
2026-03-29 10:37:16 [auto1.de] INFO: Scrape type for AE82588: 2
2026-03-29 10:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 274e51c0-e226-5fd8-a9f1-bd65eed8f0da with identifier: AE82588
2026-03-29 10:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 274e51c0-e226-5fd8-a9f1-bd65eed8f0da with scrape type 2
2026-03-29 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 274e51c0-e226-5fd8-a9f1-bd65eed8f0da with scrape type 2
2026-03-29 10:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 274e51c0-e226-5fd8-a9f1-bd65eed8f0da, identifier: AE82588
2026-03-29 10:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bf3098e4-d57f-54a3-a3da-be138a881f52 with identifier: ZV78302
2026-03-29 10:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bf3098e4-d57f-54a3-a3da-be138a881f52 with identifier: ZV78302
2026-03-29 10:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bf3098e4-d57f-54a3-a3da-be138a881f52 with identifier: ZV78302 to the API
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZV78302>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:54:21Z',
 'fuel_type': 'diesel',
 'id': 'bf3098e4-d57f-54a3-a3da-be138a881f52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV78302',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 83264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img81/05/81055e155505bb31133589885385bf3b/pa/ZV78302_8e118e85cccf76b43d4bdc2927de0867.jpg',
                'https://img-pa.auto1.com/img81/05/81055e155505bb31133589885385bf3b/pa/ZV78302_c3784f16c64421136615c3bee452e900.jpg',
                'https://img-pa.auto1.com/img81/05/81055e155505bb31133589885385bf3b/pa/ZV78302_7ec08145cf176f7f9268b2dde74ee433.jpg',
                'https://img-pa.auto1.com/img81/05/81055e155505bb31133589885385bf3b/pa/ZV78302_abfc10279d93bf317a0c9268f92305f6.jpg',
                'https://img-pa.auto1.com/img81/05/81055e155505bb31133589885385bf3b/pa/ZV78302_7613961bf802e9348d9e7238a7151b14.jpg',
                'https://img-pa.auto1.com/img81/05/81055e155505bb31133589885385bf3b/pa/ZV78302_383587b2ab5da926731ad0597d08d0da.jpg',
                'https://img-pa.auto1.com/img81/05/81055e155505bb31133589885385bf3b/pa/ZV78302_0e0e71e6b8d919773d930efa61e2c196.jpg',
                'https://img-pa.auto1.com/img81/05/81055e155505bb31133589885385bf3b/pa/ZV78302_8593dad73f631323e7b8cd4e15f4c460.jpg',
                'https://img-pa.auto1.com/img81/05/81055e155505bb31133589885385bf3b/pa/ZV78302_478b635a2e0c5143bab68c52a745ccce.jpg',
                'https://img-pa.auto1.com/img81/05/81055e155505bb31133589885385bf3b/pa/ZV78302_4c79b7489e29da2bc9303ade885377bb.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf3098e4-d57f-54a3-a3da-be138a881f52/bf3098e4-d57f-54a3-a3da-be138a881f52_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/05/81055e155505bb31133589885385bf3b/pa/ZV78302_8e118e85cccf76b43d4bdc2927de0867.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf3098e4-d57f-54a3-a3da-be138a881f52/bf3098e4-d57f-54a3-a3da-be138a881f52_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/05/81055e155505bb31133589885385bf3b/pa/ZV78302_c3784f16c64421136615c3bee452e900.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf3098e4-d57f-54a3-a3da-be138a881f52/bf3098e4-d57f-54a3-a3da-be138a881f52_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/05/81055e155505bb31133589885385bf3b/pa/ZV78302_7ec08145cf176f7f9268b2dde74ee433.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf3098e4-d57f-54a3-a3da-be138a881f52/bf3098e4-d57f-54a3-a3da-be138a881f52_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50970,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/05/81055e155505bb31133589885385bf3b/pa/ZV78302_abfc10279d93bf317a0c9268f92305f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf3098e4-d57f-54a3-a3da-be138a881f52/bf3098e4-d57f-54a3-a3da-be138a881f52_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/05/81055e155505bb31133589885385bf3b/pa/ZV78302_7613961bf802e9348d9e7238a7151b14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf3098e4-d57f-54a3-a3da-be138a881f52/bf3098e4-d57f-54a3-a3da-be138a881f52_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/05/81055e155505bb31133589885385bf3b/pa/ZV78302_383587b2ab5da926731ad0597d08d0da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf3098e4-d57f-54a3-a3da-be138a881f52/bf3098e4-d57f-54a3-a3da-be138a881f52_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/05/81055e155505bb31133589885385bf3b/pa/ZV78302_0e0e71e6b8d919773d930efa61e2c196.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf3098e4-d57f-54a3-a3da-be138a881f52/bf3098e4-d57f-54a3-a3da-be138a881f52_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72902,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/05/81055e155505bb31133589885385bf3b/pa/ZV78302_8593dad73f631323e7b8cd4e15f4c460.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf3098e4-d57f-54a3-a3da-be138a881f52/bf3098e4-d57f-54a3-a3da-be138a881f52_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/05/81055e155505bb31133589885385bf3b/pa/ZV78302_478b635a2e0c5143bab68c52a745ccce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf3098e4-d57f-54a3-a3da-be138a881f52/bf3098e4-d57f-54a3-a3da-be138a881f52_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60415,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/05/81055e155505bb31133589885385bf3b/pa/ZV78302_4c79b7489e29da2bc9303ade885377bb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2022}
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV78302%27 HTTP/1.1" 200 None
2026-03-29 10:37:16 [auto1.de] INFO: Saving data for ZV78302: {'created_time': 1774780636.544166, 'last_price_update_time': 1774780636.544182, 'auction_closing_time': 1774886061.0}
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV78302') HTTP/1.1" 204 0
2026-03-29 10:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 04b8cb32-6b71-5de2-a373-3f2258b156c7 with identifier: VT21239
2026-03-29 10:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 04b8cb32-6b71-5de2-a373-3f2258b156c7 with identifier: VT21239
2026-03-29 10:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 04b8cb32-6b71-5de2-a373-3f2258b156c7 with identifier: VT21239 to the API
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VT21239>
{'auction_title': '',
 'c_o_2_emission_value': 195,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:43:21Z',
 'fuel_type': 'diesel',
 'id': '04b8cb32-6b71-5de2-a373-3f2258b156c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT21239',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Seat',
 'model': 'Tarraco',
 'odometer': 113355,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img47/31/47312df36932a338ca1036b0cc031acf/pa/VT21239_0fc03d5ac3300ca876f71b45029b5749.jpg',
                'https://img-pa.auto1.com/img47/31/47312df36932a338ca1036b0cc031acf/pa/VT21239_dcf3d7d2fbe77636ef31b4fe767e412a.jpg',
                'https://img-pa.auto1.com/img47/31/47312df36932a338ca1036b0cc031acf/pa/VT21239_3951d14df01d7f0acbdcf9acff1832c8.jpg',
                'https://img-pa.auto1.com/img47/31/47312df36932a338ca1036b0cc031acf/pa/VT21239_3a95a0f8726226d263c33e4832647bf1.jpg',
                'https://img-pa.auto1.com/img47/31/47312df36932a338ca1036b0cc031acf/pa/VT21239_232447272d8ff4c018d7cf1c0b74fd54.jpg',
                'https://img-pa.auto1.com/img47/31/47312df36932a338ca1036b0cc031acf/pa/VT21239_a9cb402e96448ea12a947aa25f4d6c09.jpg',
                'https://img-pa.auto1.com/img47/31/47312df36932a338ca1036b0cc031acf/pa/VT21239_86dc62d4be9c14a4cfc56c9b723da974.jpg',
                'https://img-pa.auto1.com/img47/31/47312df36932a338ca1036b0cc031acf/pa/VT21239_3219e026a4dccb958bd78d80b52740af.jpg',
                'https://img-pa.auto1.com/img47/31/47312df36932a338ca1036b0cc031acf/pa/VT21239_69a773679a884b646a48873edd80b100.jpg',
                'https://img-pa.auto1.com/img47/31/47312df36932a338ca1036b0cc031acf/pa/VT21239_f3c9c6eb7b723609b45d7b7fc284a53f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04b8cb32-6b71-5de2-a373-3f2258b156c7/04b8cb32-6b71-5de2-a373-3f2258b156c7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/31/47312df36932a338ca1036b0cc031acf/pa/VT21239_0fc03d5ac3300ca876f71b45029b5749.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04b8cb32-6b71-5de2-a373-3f2258b156c7/04b8cb32-6b71-5de2-a373-3f2258b156c7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/31/47312df36932a338ca1036b0cc031acf/pa/VT21239_dcf3d7d2fbe77636ef31b4fe767e412a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04b8cb32-6b71-5de2-a373-3f2258b156c7/04b8cb32-6b71-5de2-a373-3f2258b156c7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/31/47312df36932a338ca1036b0cc031acf/pa/VT21239_3951d14df01d7f0acbdcf9acff1832c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04b8cb32-6b71-5de2-a373-3f2258b156c7/04b8cb32-6b71-5de2-a373-3f2258b156c7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/31/47312df36932a338ca1036b0cc031acf/pa/VT21239_3a95a0f8726226d263c33e4832647bf1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04b8cb32-6b71-5de2-a373-3f2258b156c7/04b8cb32-6b71-5de2-a373-3f2258b156c7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/31/47312df36932a338ca1036b0cc031acf/pa/VT21239_232447272d8ff4c018d7cf1c0b74fd54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04b8cb32-6b71-5de2-a373-3f2258b156c7/04b8cb32-6b71-5de2-a373-3f2258b156c7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/31/47312df36932a338ca1036b0cc031acf/pa/VT21239_a9cb402e96448ea12a947aa25f4d6c09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04b8cb32-6b71-5de2-a373-3f2258b156c7/04b8cb32-6b71-5de2-a373-3f2258b156c7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/31/47312df36932a338ca1036b0cc031acf/pa/VT21239_86dc62d4be9c14a4cfc56c9b723da974.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04b8cb32-6b71-5de2-a373-3f2258b156c7/04b8cb32-6b71-5de2-a373-3f2258b156c7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86649,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/31/47312df36932a338ca1036b0cc031acf/pa/VT21239_3219e026a4dccb958bd78d80b52740af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04b8cb32-6b71-5de2-a373-3f2258b156c7/04b8cb32-6b71-5de2-a373-3f2258b156c7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66952,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/31/47312df36932a338ca1036b0cc031acf/pa/VT21239_69a773679a884b646a48873edd80b100.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04b8cb32-6b71-5de2-a373-3f2258b156c7/04b8cb32-6b71-5de2-a373-3f2258b156c7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/31/47312df36932a338ca1036b0cc031acf/pa/VT21239_f3c9c6eb7b723609b45d7b7fc284a53f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Tarraco 2.0 TDI Xcellence 4Drive',
 'transmission': 'automatic',
 'trim': 'Xcellence 4Drive',
 'year': 2020}
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT21239%27 HTTP/1.1" 200 None
2026-03-29 10:37:16 [auto1.de] INFO: Saving data for VT21239: {'created_time': 1774780636.954412, 'last_price_update_time': 1774780636.954421, 'auction_closing_time': 1774885401.0}
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VT21239') HTTP/1.1" 204 0
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: BL18853
2026-03-29 10:37:16 [auto1.de] INFO: Found listing with ID: DW68241
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW68241%27 HTTP/1.1" 200 None
2026-03-29 10:37:16 [auto1.de] INFO: Scrape type for DW68241: 2
2026-03-29 10:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48f86626-7dff-5675-8fe1-5ef959ea57bf with identifier: DW68241
2026-03-29 10:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48f86626-7dff-5675-8fe1-5ef959ea57bf with scrape type 2
2026-03-29 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48f86626-7dff-5675-8fe1-5ef959ea57bf with scrape type 2
2026-03-29 10:37:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 48f86626-7dff-5675-8fe1-5ef959ea57bf, identifier: DW68241
2026-03-29 10:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 274e51c0-e226-5fd8-a9f1-bd65eed8f0da with identifier: AE82588
2026-03-29 10:37:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 274e51c0-e226-5fd8-a9f1-bd65eed8f0da with identifier: AE82588
2026-03-29 10:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 274e51c0-e226-5fd8-a9f1-bd65eed8f0da with identifier: AE82588 to the API
2026-03-29 10:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:05:46Z',
 'fuel_type': 'petrol',
 'id': '274e51c0-e226-5fd8-a9f1-bd65eed8f0da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE82588',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 98156,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-08-11',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4',
 'transmission': 'manual',
 'trim': '',
 'year': 2004}
2026-03-29 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE82588%27 HTTP/1.1" 200 None
2026-03-29 10:37:17 [auto1.de] INFO: Saving data for AE82588: {'auction_closing_time': 1774883146.0, 'created_time': 1774637404.296086, 'last_price_update_time': 1774780637.478223}
2026-03-29 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE82588') HTTP/1.1" 204 0
2026-03-29 10:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 48f86626-7dff-5675-8fe1-5ef959ea57bf with identifier: DW68241
2026-03-29 10:37:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 48f86626-7dff-5675-8fe1-5ef959ea57bf with identifier: DW68241
2026-03-29 10:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 48f86626-7dff-5675-8fe1-5ef959ea57bf with identifier: DW68241 to the API
2026-03-29 10:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-30T15:04:12Z',
 'fuel_type': 'diesel',
 'id': '48f86626-7dff-5675-8fe1-5ef959ea57bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW68241',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 104068,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-22',
 'seller_name': None,
 'title': 'Audi A6 45 TDI Mild-Hybrid quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-29 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW68241%27 HTTP/1.1" 200 None
2026-03-29 10:37:17 [auto1.de] INFO: Saving data for DW68241: {'auction_closing_time': 1774883052.0, 'created_time': 1773945820.431146, 'last_price_update_time': 1774780637.946778}
2026-03-29 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW68241') HTTP/1.1" 204 0
2026-03-29 10:37:17 [auto1.de] INFO: Found listing with ID: LS75303
2026-03-29 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS75303%27 HTTP/1.1" 200 None
2026-03-29 10:37:17 [auto1.de] INFO: Scrape type for LS75303: 2
2026-03-29 10:37:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0167c4ab-657c-536f-ba81-31148907790c with identifier: LS75303
2026-03-29 10:37:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0167c4ab-657c-536f-ba81-31148907790c with scrape type 2
2026-03-29 10:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0167c4ab-657c-536f-ba81-31148907790c with scrape type 2
2026-03-29 10:37:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0167c4ab-657c-536f-ba81-31148907790c, identifier: LS75303
2026-03-29 10:37:18 [auto1.de] INFO: Found listing with ID: GX07003
2026-03-29 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX07003%27 HTTP/1.1" 200 None
2026-03-29 10:37:18 [auto1.de] INFO: Scrape type for GX07003: 2
2026-03-29 10:37:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72ea1f31-66a0-5c9d-8df0-8821b8983893 with identifier: GX07003
2026-03-29 10:37:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72ea1f31-66a0-5c9d-8df0-8821b8983893 with scrape type 2
2026-03-29 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72ea1f31-66a0-5c9d-8df0-8821b8983893 with scrape type 2
2026-03-29 10:37:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 72ea1f31-66a0-5c9d-8df0-8821b8983893, identifier: GX07003
2026-03-29 10:37:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0167c4ab-657c-536f-ba81-31148907790c with identifier: LS75303
2026-03-29 10:37:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0167c4ab-657c-536f-ba81-31148907790c with identifier: LS75303
2026-03-29 10:37:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0167c4ab-657c-536f-ba81-31148907790c with identifier: LS75303 to the API
2026-03-29 10:37:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:14:05Z',
 'fuel_type': 'diesel',
 'id': '0167c4ab-657c-536f-ba81-31148907790c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS75303',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf IV',
 'odometer': 445909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-10-14',
 'seller_name': None,
 'title': 'Volkswagen Golf IV 1.9 TDI Special',
 'transmission': 'automatic',
 'trim': 'Special',
 'year': 2002}
2026-03-29 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS75303%27 HTTP/1.1" 200 None
2026-03-29 10:37:18 [auto1.de] INFO: Saving data for LS75303: {'auction_closing_time': 1774883645.0, 'created_time': 1774637269.847014, 'last_price_update_time': 1774780638.615688}
2026-03-29 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LS75303') HTTP/1.1" 204 0
2026-03-29 10:37:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 72ea1f31-66a0-5c9d-8df0-8821b8983893 with identifier: GX07003
2026-03-29 10:37:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 72ea1f31-66a0-5c9d-8df0-8821b8983893 with identifier: GX07003
2026-03-29 10:37:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 72ea1f31-66a0-5c9d-8df0-8821b8983893 with identifier: GX07003 to the API
2026-03-29 10:37:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:32:49Z',
 'fuel_type': 'petrol',
 'id': '72ea1f31-66a0-5c9d-8df0-8821b8983893',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX07003',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Colt',
 'odometer': 176510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-29',
 'seller_name': None,
 'title': 'Mitsubishi Colt 1.1 ClearTec EDITION',
 'transmission': 'manual',
 'trim': 'ClearTec EDITION',
 'year': 2012}
2026-03-29 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX07003%27 HTTP/1.1" 200 None
2026-03-29 10:37:18 [auto1.de] INFO: Saving data for GX07003: {'auction_closing_time': 1774884769.0, 'created_time': 1773689242.900957, 'last_price_update_time': 1774780638.952765}
2026-03-29 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX07003') HTTP/1.1" 204 0
2026-03-29 10:37:18 [auto1.de] INFO: Found listing with ID: PN52671
2026-03-29 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN52671%27 HTTP/1.1" 200 None
2026-03-29 10:37:18 [auto1.de] INFO: Scrape type for PN52671: 2
2026-03-29 10:37:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6f647f6-c20d-56de-9091-66d14b9b1f4a with identifier: PN52671
2026-03-29 10:37:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6f647f6-c20d-56de-9091-66d14b9b1f4a with scrape type 2
2026-03-29 10:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6f647f6-c20d-56de-9091-66d14b9b1f4a with scrape type 2
2026-03-29 10:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6f647f6-c20d-56de-9091-66d14b9b1f4a, identifier: PN52671
2026-03-29 10:37:19 [auto1.de] INFO: Found listing with ID: AE08285
2026-03-29 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE08285%27 HTTP/1.1" 200 None
2026-03-29 10:37:19 [auto1.de] INFO: Scrape type for AE08285: 1
2026-03-29 10:37:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6f647f6-c20d-56de-9091-66d14b9b1f4a with identifier: PN52671
2026-03-29 10:37:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6f647f6-c20d-56de-9091-66d14b9b1f4a with identifier: PN52671
2026-03-29 10:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6f647f6-c20d-56de-9091-66d14b9b1f4a with identifier: PN52671 to the API
2026-03-29 10:37:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:10:04Z',
 'fuel_type': 'diesel',
 'id': 'a6f647f6-c20d-56de-9091-66d14b9b1f4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN52671',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '407',
 'odometer': 246750,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-26',
 'seller_name': None,
 'title': 'Peugeot 407 2.0 HDi Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2009}
2026-03-29 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN52671%27 HTTP/1.1" 200 None
2026-03-29 10:37:19 [auto1.de] INFO: Saving data for PN52671: {'auction_closing_time': 1774883404.0, 'created_time': 1773383452.275822, 'last_price_update_time': 1774780639.416668}
2026-03-29 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PN52671') HTTP/1.1" 204 0
2026-03-29 10:37:19 [auto1.de] INFO: Found listing with ID: VH02312
2026-03-29 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH02312%27 HTTP/1.1" 200 None
2026-03-29 10:37:19 [auto1.de] INFO: Scrape type for VH02312: 2
2026-03-29 10:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0bbaef4-b322-5953-bfd2-76324f7a278f with identifier: VH02312
2026-03-29 10:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0bbaef4-b322-5953-bfd2-76324f7a278f with scrape type 2
2026-03-29 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0bbaef4-b322-5953-bfd2-76324f7a278f with scrape type 2
2026-03-29 10:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0bbaef4-b322-5953-bfd2-76324f7a278f, identifier: VH02312
2026-03-29 10:37:19 [auto1.de] INFO: Found listing with ID: XE49281
2026-03-29 10:37:19 [auto1.de] INFO: Found listing with ID: BV75755
2026-03-29 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV75755%27 HTTP/1.1" 200 None
2026-03-29 10:37:19 [auto1.de] INFO: Scrape type for BV75755: 2
2026-03-29 10:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 473b039e-ca9c-5f93-aff5-b26ef85df55d with identifier: BV75755
2026-03-29 10:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 473b039e-ca9c-5f93-aff5-b26ef85df55d with scrape type 2
2026-03-29 10:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 473b039e-ca9c-5f93-aff5-b26ef85df55d with scrape type 2
2026-03-29 10:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 473b039e-ca9c-5f93-aff5-b26ef85df55d, identifier: BV75755
2026-03-29 10:37:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0bbaef4-b322-5953-bfd2-76324f7a278f with identifier: VH02312
2026-03-29 10:37:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0bbaef4-b322-5953-bfd2-76324f7a278f with identifier: VH02312
2026-03-29 10:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0bbaef4-b322-5953-bfd2-76324f7a278f with identifier: VH02312 to the API
2026-03-29 10:37:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:34:22Z',
 'fuel_type': 'petrol',
 'id': 'a0bbaef4-b322-5953-bfd2-76324f7a278f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH02312',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf IV',
 'odometer': 134086,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-10-05',
 'seller_name': None,
 'title': 'Volkswagen Golf IV 1.6 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2003}
2026-03-29 10:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH02312%27 HTTP/1.1" 200 None
2026-03-29 10:37:20 [auto1.de] INFO: Saving data for VH02312: {'auction_closing_time': 1774884862.0, 'created_time': 1774550927.225985, 'last_price_update_time': 1774780640.004704}
2026-03-29 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH02312') HTTP/1.1" 204 0
2026-03-29 10:37:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 473b039e-ca9c-5f93-aff5-b26ef85df55d with identifier: BV75755
2026-03-29 10:37:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 473b039e-ca9c-5f93-aff5-b26ef85df55d with identifier: BV75755
2026-03-29 10:37:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 473b039e-ca9c-5f93-aff5-b26ef85df55d with identifier: BV75755 to the API
2026-03-29 10:37:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:24:21Z',
 'fuel_type': 'petrol',
 'id': '473b039e-ca9c-5f93-aff5-b26ef85df55d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV75755',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '407',
 'odometer': 148695,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-12-13',
 'seller_name': None,
 'title': 'Peugeot 407 3.0 V6 Platinum',
 'transmission': 'automatic',
 'trim': 'Platinum',
 'year': 2005}
2026-03-29 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV75755%27 HTTP/1.1" 200 None
2026-03-29 10:37:20 [auto1.de] INFO: Saving data for BV75755: {'auction_closing_time': 1774884261.0, 'created_time': 1774638353.858507, 'last_price_update_time': 1774780640.342648}
2026-03-29 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV75755') HTTP/1.1" 204 0
2026-03-29 10:37:20 [auto1.de] INFO: Found listing with ID: NN25217
2026-03-29 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN25217%27 HTTP/1.1" 200 None
2026-03-29 10:37:20 [auto1.de] INFO: Scrape type for NN25217: 2
2026-03-29 10:37:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58c5d78f-62f9-50c1-91fd-0120b1569370 with identifier: NN25217
2026-03-29 10:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58c5d78f-62f9-50c1-91fd-0120b1569370 with scrape type 2
2026-03-29 10:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58c5d78f-62f9-50c1-91fd-0120b1569370 with scrape type 2
2026-03-29 10:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58c5d78f-62f9-50c1-91fd-0120b1569370, identifier: NN25217
2026-03-29 10:37:20 [auto1.de] INFO: Found listing with ID: GZ46196
2026-03-29 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ46196%27 HTTP/1.1" 200 None
2026-03-29 10:37:20 [auto1.de] INFO: Scrape type for GZ46196: 2
2026-03-29 10:37:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04129cd5-49d2-5fc8-9463-32075e556860 with identifier: GZ46196
2026-03-29 10:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04129cd5-49d2-5fc8-9463-32075e556860 with scrape type 2
2026-03-29 10:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04129cd5-49d2-5fc8-9463-32075e556860 with scrape type 2
2026-03-29 10:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 04129cd5-49d2-5fc8-9463-32075e556860, identifier: GZ46196
2026-03-29 10:37:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58c5d78f-62f9-50c1-91fd-0120b1569370 with identifier: NN25217
2026-03-29 10:37:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58c5d78f-62f9-50c1-91fd-0120b1569370 with identifier: NN25217
2026-03-29 10:37:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58c5d78f-62f9-50c1-91fd-0120b1569370 with identifier: NN25217 to the API
2026-03-29 10:37:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:14:47Z',
 'fuel_type': 'petrol',
 'id': '58c5d78f-62f9-50c1-91fd-0120b1569370',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN25217',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 85584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-01-26',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2003}
2026-03-29 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN25217%27 HTTP/1.1" 200 None
2026-03-29 10:37:21 [auto1.de] INFO: Saving data for NN25217: {'auction_closing_time': 1774883687.0, 'created_time': 1773775810.730187, 'last_price_update_time': 1774780641.136199}
2026-03-29 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NN25217') HTTP/1.1" 204 0
2026-03-29 10:37:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 04129cd5-49d2-5fc8-9463-32075e556860 with identifier: GZ46196
2026-03-29 10:37:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 04129cd5-49d2-5fc8-9463-32075e556860 with identifier: GZ46196
2026-03-29 10:37:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 04129cd5-49d2-5fc8-9463-32075e556860 with identifier: GZ46196 to the API
2026-03-29 10:37:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:02:21Z',
 'fuel_type': 'petrol',
 'id': '04129cd5-49d2-5fc8-9463-32075e556860',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ46196',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Matiz',
 'odometer': 180480,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-08-30',
 'seller_name': None,
 'title': 'Chevrolet Matiz 1.0 SE',
 'transmission': 'manual',
 'trim': 'SE',
 'year': 2007}
2026-03-29 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ46196%27 HTTP/1.1" 200 None
2026-03-29 10:37:21 [auto1.de] INFO: Saving data for GZ46196: {'auction_closing_time': 1774882941.0, 'created_time': 1774550685.23626, 'last_price_update_time': 1774780641.490153}
2026-03-29 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ46196') HTTP/1.1" 204 0
2026-03-29 10:37:21 [auto1.de] INFO: Found listing with ID: SR95486
2026-03-29 10:37:21 [auto1.de] INFO: Found listing with ID: NL19683
2026-03-29 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL19683%27 HTTP/1.1" 200 None
2026-03-29 10:37:21 [auto1.de] INFO: Scrape type for NL19683: 2
2026-03-29 10:37:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48a3ce89-5d9f-589f-bd48-5c676fe374d0 with identifier: NL19683
2026-03-29 10:37:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48a3ce89-5d9f-589f-bd48-5c676fe374d0 with scrape type 2
2026-03-29 10:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48a3ce89-5d9f-589f-bd48-5c676fe374d0 with scrape type 2
2026-03-29 10:37:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 48a3ce89-5d9f-589f-bd48-5c676fe374d0, identifier: NL19683
2026-03-29 10:37:21 [auto1.de] INFO: Found listing with ID: SY67219
2026-03-29 10:37:21 [auto1.de] INFO: Found listing with ID: UW13006
2026-03-29 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW13006%27 HTTP/1.1" 200 None
2026-03-29 10:37:21 [auto1.de] INFO: Scrape type for UW13006: 2
2026-03-29 10:37:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d467e812-dd3f-5a56-9fc2-ac0a9fb79c94 with identifier: UW13006
2026-03-29 10:37:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d467e812-dd3f-5a56-9fc2-ac0a9fb79c94 with scrape type 2
2026-03-29 10:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d467e812-dd3f-5a56-9fc2-ac0a9fb79c94 with scrape type 2
2026-03-29 10:37:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d467e812-dd3f-5a56-9fc2-ac0a9fb79c94, identifier: UW13006
2026-03-29 10:37:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 48a3ce89-5d9f-589f-bd48-5c676fe374d0 with identifier: NL19683
2026-03-29 10:37:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 48a3ce89-5d9f-589f-bd48-5c676fe374d0 with identifier: NL19683
2026-03-29 10:37:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 48a3ce89-5d9f-589f-bd48-5c676fe374d0 with identifier: NL19683 to the API
2026-03-29 10:37:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:41:07Z',
 'fuel_type': 'petrol',
 'id': '48a3ce89-5d9f-589f-bd48-5c676fe374d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL19683',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 77828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-20',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 Tekna',
 'transmission': 'automatic',
 'trim': 'Tekna',
 'year': 2017}
2026-03-29 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL19683%27 HTTP/1.1" 200 None
2026-03-29 10:37:22 [auto1.de] INFO: Saving data for NL19683: {'auction_closing_time': 1774885267.0, 'created_time': 1774292329.063223, 'last_price_update_time': 1774780642.057633}
2026-03-29 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NL19683') HTTP/1.1" 204 0
2026-03-29 10:37:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WL17880> (referer: https://www.auto1.com/v1/car-details-view/WL17880/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WW76911> (referer: https://www.auto1.com/v1/car-details-view/WW76911/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d467e812-dd3f-5a56-9fc2-ac0a9fb79c94 with identifier: UW13006
2026-03-29 10:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d467e812-dd3f-5a56-9fc2-ac0a9fb79c94 with identifier: UW13006
2026-03-29 10:37:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d467e812-dd3f-5a56-9fc2-ac0a9fb79c94 with identifier: UW13006 to the API
2026-03-29 10:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:24:58Z',
 'fuel_type': 'petrol',
 'id': 'd467e812-dd3f-5a56-9fc2-ac0a9fb79c94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW13006',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 81596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-01',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2018}
2026-03-29 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW13006%27 HTTP/1.1" 200 None
2026-03-29 10:37:22 [auto1.de] INFO: Saving data for UW13006: {'auction_closing_time': 1774884298.0, 'created_time': 1774551850.515072, 'last_price_update_time': 1774780642.47602}
2026-03-29 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UW13006') HTTP/1.1" 204 0
2026-03-29 10:37:22 [auto1.de] INFO: Found listing with ID: SV33608
2026-03-29 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV33608%27 HTTP/1.1" 200 None
2026-03-29 10:37:22 [auto1.de] INFO: Scrape type for SV33608: 2
2026-03-29 10:37:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cb16e13-d4dd-5d15-b1a7-1e80ab2173c4 with identifier: SV33608
2026-03-29 10:37:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cb16e13-d4dd-5d15-b1a7-1e80ab2173c4 with scrape type 2
2026-03-29 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cb16e13-d4dd-5d15-b1a7-1e80ab2173c4 with scrape type 2
2026-03-29 10:37:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0cb16e13-d4dd-5d15-b1a7-1e80ab2173c4, identifier: SV33608
2026-03-29 10:37:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NY52199> (referer: https://www.auto1.com/v1/car-details-view/NY52199/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:22 [auto1.de] INFO: Found listing with ID: WE35343
2026-03-29 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE35343%27 HTTP/1.1" 200 None
2026-03-29 10:37:22 [auto1.de] INFO: Scrape type for WE35343: 2
2026-03-29 10:37:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36c19ece-d008-5e77-80ae-9ab4fc3f4d77 with identifier: WE35343
2026-03-29 10:37:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36c19ece-d008-5e77-80ae-9ab4fc3f4d77 with scrape type 2
2026-03-29 10:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36c19ece-d008-5e77-80ae-9ab4fc3f4d77 with scrape type 2
2026-03-29 10:37:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36c19ece-d008-5e77-80ae-9ab4fc3f4d77, identifier: WE35343
2026-03-29 10:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0cb16e13-d4dd-5d15-b1a7-1e80ab2173c4 with identifier: SV33608
2026-03-29 10:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0cb16e13-d4dd-5d15-b1a7-1e80ab2173c4 with identifier: SV33608
2026-03-29 10:37:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0cb16e13-d4dd-5d15-b1a7-1e80ab2173c4 with identifier: SV33608 to the API
2026-03-29 10:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-30T15:07:03Z',
 'fuel_type': 'petrol',
 'id': '0cb16e13-d4dd-5d15-b1a7-1e80ab2173c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV33608',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 83402,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-23',
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse S 400 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2017}
2026-03-29 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV33608%27 HTTP/1.1" 200 None
2026-03-29 10:37:23 [auto1.de] INFO: Saving data for SV33608: {'auction_closing_time': 1774883223.0, 'created_time': 1774379460.989364, 'last_price_update_time': 1774780643.251831}
2026-03-29 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV33608') HTTP/1.1" 204 0
2026-03-29 10:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36c19ece-d008-5e77-80ae-9ab4fc3f4d77 with identifier: WE35343
2026-03-29 10:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36c19ece-d008-5e77-80ae-9ab4fc3f4d77 with identifier: WE35343
2026-03-29 10:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36c19ece-d008-5e77-80ae-9ab4fc3f4d77 with identifier: WE35343 to the API
2026-03-29 10:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:56:45Z',
 'fuel_type': 'petrol',
 'id': '36c19ece-d008-5e77-80ae-9ab4fc3f4d77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE35343',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 158945,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-10',
 'seller_name': None,
 'title': "Kia cee'd 1.4 Dream Team",
 'transmission': 'manual',
 'trim': 'Dream Team',
 'year': 2015}
2026-03-29 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE35343%27 HTTP/1.1" 200 None
2026-03-29 10:37:23 [auto1.de] INFO: Saving data for WE35343: {'auction_closing_time': 1774886205.0, 'created_time': 1773520203.948166, 'last_price_update_time': 1774780643.628191}
2026-03-29 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE35343') HTTP/1.1" 204 0
2026-03-29 10:37:23 [auto1.de] INFO: Found listing with ID: JW05859
2026-03-29 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW05859%27 HTTP/1.1" 200 None
2026-03-29 10:37:23 [auto1.de] INFO: Scrape type for JW05859: 2
2026-03-29 10:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b426d51-ccf0-5edf-a255-1ddf6bfcb698 with identifier: JW05859
2026-03-29 10:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b426d51-ccf0-5edf-a255-1ddf6bfcb698 with scrape type 2
2026-03-29 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b426d51-ccf0-5edf-a255-1ddf6bfcb698 with scrape type 2
2026-03-29 10:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b426d51-ccf0-5edf-a255-1ddf6bfcb698, identifier: JW05859
2026-03-29 10:37:23 [auto1.de] INFO: Found listing with ID: NL19475
2026-03-29 10:37:23 [auto1.de] INFO: Found listing with ID: WJ46196
2026-03-29 10:37:23 [auto1.de] INFO: Found listing with ID: AT70381
2026-03-29 10:37:23 [auto1.de] INFO: Found listing with ID: VN12200
2026-03-29 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN12200%27 HTTP/1.1" 200 None
2026-03-29 10:37:23 [auto1.de] INFO: Scrape type for VN12200: 2
2026-03-29 10:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5363727-5ce7-5159-b539-b567415ec1e9 with identifier: VN12200
2026-03-29 10:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5363727-5ce7-5159-b539-b567415ec1e9 with scrape type 2
2026-03-29 10:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5363727-5ce7-5159-b539-b567415ec1e9 with scrape type 2
2026-03-29 10:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5363727-5ce7-5159-b539-b567415ec1e9, identifier: VN12200
2026-03-29 10:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b426d51-ccf0-5edf-a255-1ddf6bfcb698 with identifier: JW05859
2026-03-29 10:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b426d51-ccf0-5edf-a255-1ddf6bfcb698 with identifier: JW05859
2026-03-29 10:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b426d51-ccf0-5edf-a255-1ddf6bfcb698 with identifier: JW05859 to the API
2026-03-29 10:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:12:43Z',
 'fuel_type': 'petrol',
 'id': '0b426d51-ccf0-5edf-a255-1ddf6bfcb698',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW05859',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 84139,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-07',
 'seller_name': None,
 'title': 'Skoda Kamiq 1.5 TSI ACT Monte Carlo',
 'transmission': 'automatic',
 'trim': 'Monte Carlo',
 'year': 2021}
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW05859%27 HTTP/1.1" 200 None
2026-03-29 10:37:24 [auto1.de] INFO: Saving data for JW05859: {'auction_closing_time': 1774883563.0, 'created_time': 1773227652.654152, 'last_price_update_time': 1774780644.258369}
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JW05859') HTTP/1.1" 204 0
2026-03-29 10:37:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5363727-5ce7-5159-b539-b567415ec1e9 with identifier: VN12200
2026-03-29 10:37:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5363727-5ce7-5159-b539-b567415ec1e9 with identifier: VN12200
2026-03-29 10:37:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5363727-5ce7-5159-b539-b567415ec1e9 with identifier: VN12200 to the API
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-30T15:03:50Z',
 'fuel_type': 'diesel',
 'id': 'b5363727-5ce7-5159-b539-b567415ec1e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN12200',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 290606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-19',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 320 CDI 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2008}
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN12200%27 HTTP/1.1" 200 None
2026-03-29 10:37:24 [auto1.de] INFO: Saving data for VN12200: {'auction_closing_time': 1774883030.0, 'created_time': 1774035031.644207, 'last_price_update_time': 1774780644.650287}
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN12200') HTTP/1.1" 204 0
2026-03-29 10:37:24 [auto1.de] INFO: Found listing with ID: WL45010
2026-03-29 10:37:24 [auto1.de] INFO: Found listing with ID: YG26489
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG26489%27 HTTP/1.1" 200 None
2026-03-29 10:37:24 [auto1.de] INFO: Scrape type for YG26489: 2
2026-03-29 10:37:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 106ce988-c22e-5bac-b92a-9279771cc858 with identifier: YG26489
2026-03-29 10:37:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 106ce988-c22e-5bac-b92a-9279771cc858 with scrape type 2
2026-03-29 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 106ce988-c22e-5bac-b92a-9279771cc858 with scrape type 2
2026-03-29 10:37:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 106ce988-c22e-5bac-b92a-9279771cc858, identifier: YG26489
2026-03-29 10:37:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14606920-0247-56f0-902e-8e89226fbc2f with identifier: WL17880
2026-03-29 10:37:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14606920-0247-56f0-902e-8e89226fbc2f with scrape type 1
2026-03-29 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 14606920-0247-56f0-902e-8e89226fbc2f
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F22%252F2f22b56beec7ea5e60bcd206d7b79d93%252Fpa%252FWL17880_50e42580c5b3fc7407e0dc0ad0bb4089.png%27 HTTP/1.1" 200 None
2026-03-29 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/22/2f22b56beec7ea5e60bcd206d7b79d93/pa/WL17880_50e42580c5b3fc7407e0dc0ad0bb4089.png already downloaded
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F22%252F2f22b56beec7ea5e60bcd206d7b79d93%252Fpa%252FWL17880_6ccc20ab30ce637777de53c7b6bf0eeb.png%27 HTTP/1.1" 200 None
2026-03-29 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/22/2f22b56beec7ea5e60bcd206d7b79d93/pa/WL17880_6ccc20ab30ce637777de53c7b6bf0eeb.png already downloaded
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F22%252F2f22b56beec7ea5e60bcd206d7b79d93%252Fpa%252FWL17880_0825cf98cf1e8886031235f7d92ebd4a.png%27 HTTP/1.1" 200 None
2026-03-29 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/22/2f22b56beec7ea5e60bcd206d7b79d93/pa/WL17880_0825cf98cf1e8886031235f7d92ebd4a.png already downloaded
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F22%252F2f22b56beec7ea5e60bcd206d7b79d93%252Fpa%252FWL17880_8e5447af8c0484667e47f81802db4b2e.png%27 HTTP/1.1" 200 None
2026-03-29 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/22/2f22b56beec7ea5e60bcd206d7b79d93/pa/WL17880_8e5447af8c0484667e47f81802db4b2e.png already downloaded
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F22%252F2f22b56beec7ea5e60bcd206d7b79d93%252Fpa%252FWL17880_100f9107568773eb3acf54207904d2aa.png%27 HTTP/1.1" 200 None
2026-03-29 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/22/2f22b56beec7ea5e60bcd206d7b79d93/pa/WL17880_100f9107568773eb3acf54207904d2aa.png already downloaded
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F22%252F2f22b56beec7ea5e60bcd206d7b79d93%252Fpa%252FWL17880_c7c0f8613178b5b78daedf081b6039db.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/22/2f22b56beec7ea5e60bcd206d7b79d93/pa/WL17880_c7c0f8613178b5b78daedf081b6039db.jpg already downloaded
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F22%252F2f22b56beec7ea5e60bcd206d7b79d93%252Fpa%252FWL17880_8e100aebde7a2c315428a384d14fefee.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/22/2f22b56beec7ea5e60bcd206d7b79d93/pa/WL17880_8e100aebde7a2c315428a384d14fefee.jpg already downloaded
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F22%252F2f22b56beec7ea5e60bcd206d7b79d93%252Fpa%252FWL17880_90d01cc49f6e55cc1cd345ffaf85cc13.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/22/2f22b56beec7ea5e60bcd206d7b79d93/pa/WL17880_90d01cc49f6e55cc1cd345ffaf85cc13.jpg already downloaded
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F22%252F2f22b56beec7ea5e60bcd206d7b79d93%252Fpa%252FWL17880_dadb9ca5d753adfb1a377eb2ffb222a2.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/22/2f22b56beec7ea5e60bcd206d7b79d93/pa/WL17880_dadb9ca5d753adfb1a377eb2ffb222a2.jpg already downloaded
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F22%252F2f22b56beec7ea5e60bcd206d7b79d93%252Fpa%252FWL17880_3b00e9b8ab6ffe324d7c631a352860f6.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/22/2f22b56beec7ea5e60bcd206d7b79d93/pa/WL17880_3b00e9b8ab6ffe324d7c631a352860f6.jpg already downloaded
2026-03-29 10:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14606920-0247-56f0-902e-8e89226fbc2f, identifier: WL17880
2026-03-29 10:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3d603a4-4f42-52c8-9e1a-71af0b203059 with identifier: WW76911
2026-03-29 10:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3d603a4-4f42-52c8-9e1a-71af0b203059 with scrape type 1
2026-03-29 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f3d603a4-4f42-52c8-9e1a-71af0b203059
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F6b%252F3d6ba89a8e90c63eba960c396e836a31%252Fpa%252FWW76911_cc70878129a10db8cb219ea2f291199f.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/6b/3d6ba89a8e90c63eba960c396e836a31/pa/WW76911_cc70878129a10db8cb219ea2f291199f.jpg already downloaded
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F6b%252F3d6ba89a8e90c63eba960c396e836a31%252Fpa%252FWW76911_a917e233e852491667802cd7dac0e440.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/6b/3d6ba89a8e90c63eba960c396e836a31/pa/WW76911_a917e233e852491667802cd7dac0e440.jpg already downloaded
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F6b%252F3d6ba89a8e90c63eba960c396e836a31%252Fpa%252FWW76911_802bcb89413a6c57124680d157d48ad3.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/6b/3d6ba89a8e90c63eba960c396e836a31/pa/WW76911_802bcb89413a6c57124680d157d48ad3.jpg already downloaded
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F6b%252F3d6ba89a8e90c63eba960c396e836a31%252Fpa%252FWW76911_e2955a2e1c426678d66c671f5abf32aa.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/6b/3d6ba89a8e90c63eba960c396e836a31/pa/WW76911_e2955a2e1c426678d66c671f5abf32aa.jpg already downloaded
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F6b%252F3d6ba89a8e90c63eba960c396e836a31%252Fpa%252FWW76911_2f7bf3f5515da0573eeb5f3630a0e7c1.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/6b/3d6ba89a8e90c63eba960c396e836a31/pa/WW76911_2f7bf3f5515da0573eeb5f3630a0e7c1.jpg already downloaded
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F6b%252F3d6ba89a8e90c63eba960c396e836a31%252Fpa%252FWW76911_db24986d600d16971da4c6a4eb544296.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/6b/3d6ba89a8e90c63eba960c396e836a31/pa/WW76911_db24986d600d16971da4c6a4eb544296.jpg already downloaded
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F6b%252F3d6ba89a8e90c63eba960c396e836a31%252Fpa%252FWW76911_2a00aa8e03487885a9fce29a4d4b2609.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/6b/3d6ba89a8e90c63eba960c396e836a31/pa/WW76911_2a00aa8e03487885a9fce29a4d4b2609.jpg already downloaded
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F6b%252F3d6ba89a8e90c63eba960c396e836a31%252Fpa%252FWW76911_3d1e25279cf139e22f38c9e818718129.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/6b/3d6ba89a8e90c63eba960c396e836a31/pa/WW76911_3d1e25279cf139e22f38c9e818718129.jpg already downloaded
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F6b%252F3d6ba89a8e90c63eba960c396e836a31%252Fpa%252FWW76911_6b60b9cf7e6c75e7e31f28fdacc06ead.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/6b/3d6ba89a8e90c63eba960c396e836a31/pa/WW76911_6b60b9cf7e6c75e7e31f28fdacc06ead.jpg already downloaded
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F6b%252F3d6ba89a8e90c63eba960c396e836a31%252Fpa%252FWW76911_400fbe5d2d8cefd9e5221f6c3df256a0.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/6b/3d6ba89a8e90c63eba960c396e836a31/pa/WW76911_400fbe5d2d8cefd9e5221f6c3df256a0.jpg already downloaded
2026-03-29 10:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f3d603a4-4f42-52c8-9e1a-71af0b203059, identifier: WW76911
2026-03-29 10:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6a23ac0-277f-541d-a641-0d8b78e6919d with identifier: NY52199
2026-03-29 10:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6a23ac0-277f-541d-a641-0d8b78e6919d with scrape type 1
2026-03-29 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b6a23ac0-277f-541d-a641-0d8b78e6919d
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fb7%252F30b7672e7318387755de62e07b6bdb88%252Fpa%252FNY52199_4b2c13c329e3e603b71528be99591150.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/b7/30b7672e7318387755de62e07b6bdb88/pa/NY52199_4b2c13c329e3e603b71528be99591150.jpg already downloaded
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fb7%252F30b7672e7318387755de62e07b6bdb88%252Fpa%252FNY52199_e1b1f56e91dbb2aa6030bffe116cc11d.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/b7/30b7672e7318387755de62e07b6bdb88/pa/NY52199_e1b1f56e91dbb2aa6030bffe116cc11d.jpg already downloaded
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fb7%252F30b7672e7318387755de62e07b6bdb88%252Fpa%252FNY52199_11af5da679d906cb0bf9ff2d4c62a376.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/b7/30b7672e7318387755de62e07b6bdb88/pa/NY52199_11af5da679d906cb0bf9ff2d4c62a376.jpg already downloaded
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fb7%252F30b7672e7318387755de62e07b6bdb88%252Fpa%252FNY52199_75d8d6d9bd15263d319ec612ddd8548c.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/b7/30b7672e7318387755de62e07b6bdb88/pa/NY52199_75d8d6d9bd15263d319ec612ddd8548c.jpg already downloaded
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fb7%252F30b7672e7318387755de62e07b6bdb88%252Fpa%252FNY52199_9be94df88eacf5e50e1d3cd8f6ead781.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/b7/30b7672e7318387755de62e07b6bdb88/pa/NY52199_9be94df88eacf5e50e1d3cd8f6ead781.jpg already downloaded
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fb7%252F30b7672e7318387755de62e07b6bdb88%252Fpa%252FNY52199_9c2b2c931a3a16a1e3b6fe0fc70b48c2.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/b7/30b7672e7318387755de62e07b6bdb88/pa/NY52199_9c2b2c931a3a16a1e3b6fe0fc70b48c2.jpg already downloaded
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fb7%252F30b7672e7318387755de62e07b6bdb88%252Fpa%252FNY52199_2075c9424aa3b85c483cd966c1e68cbc.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/b7/30b7672e7318387755de62e07b6bdb88/pa/NY52199_2075c9424aa3b85c483cd966c1e68cbc.jpg already downloaded
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fb7%252F30b7672e7318387755de62e07b6bdb88%252Fpa%252FNY52199_ede030e39f907f26685313a0d38d3134.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/b7/30b7672e7318387755de62e07b6bdb88/pa/NY52199_ede030e39f907f26685313a0d38d3134.jpg already downloaded
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fb7%252F30b7672e7318387755de62e07b6bdb88%252Fpa%252FNY52199_bbd823acb7fd6970ef84cbc5684c0961.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/b7/30b7672e7318387755de62e07b6bdb88/pa/NY52199_bbd823acb7fd6970ef84cbc5684c0961.jpg already downloaded
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fb7%252F30b7672e7318387755de62e07b6bdb88%252Fpa%252FNY52199_465c9496e65f9d3e9991870b48f69d72.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/b7/30b7672e7318387755de62e07b6bdb88/pa/NY52199_465c9496e65f9d3e9991870b48f69d72.jpg already downloaded
2026-03-29 10:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6a23ac0-277f-541d-a641-0d8b78e6919d, identifier: NY52199
2026-03-29 10:37:25 [auto1.de] INFO: Channel: 24h | Page: 11 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:25 [auto1.de] INFO: Found listing with ID: HE00957
2026-03-29 10:37:25 [auto1.de] INFO: Found listing with ID: MS26334
2026-03-29 10:37:25 [auto1.de] INFO: Found listing with ID: PJ99813
2026-03-29 10:37:25 [auto1.de] INFO: Found listing with ID: WP80129
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP80129%27 HTTP/1.1" 200 None
2026-03-29 10:37:25 [auto1.de] INFO: Scrape type for WP80129: 1
2026-03-29 10:37:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 106ce988-c22e-5bac-b92a-9279771cc858 with identifier: YG26489
2026-03-29 10:37:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 106ce988-c22e-5bac-b92a-9279771cc858 with identifier: YG26489
2026-03-29 10:37:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 106ce988-c22e-5bac-b92a-9279771cc858 with identifier: YG26489 to the API
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 374,
 'expiration_date': '2026-03-30T15:56:45Z',
 'fuel_type': 'petrol',
 'id': '106ce988-c22e-5bac-b92a-9279771cc858',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG26489',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 24747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-28',
 'seller_name': None,
 'title': 'BMW 2er M240i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2023}
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG26489%27 HTTP/1.1" 200 None
2026-03-29 10:37:25 [auto1.de] INFO: Saving data for YG26489: {'auction_closing_time': 1774886205.0, 'created_time': 1774379362.484869, 'last_price_update_time': 1774780645.994728}
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YG26489') HTTP/1.1" 204 0
2026-03-29 10:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14606920-0247-56f0-902e-8e89226fbc2f with identifier: WL17880
2026-03-29 10:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14606920-0247-56f0-902e-8e89226fbc2f with identifier: WL17880
2026-03-29 10:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14606920-0247-56f0-902e-8e89226fbc2f with identifier: WL17880 to the API
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WL17880>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:14:19Z',
 'fuel_type': 'diesel',
 'id': '14606920-0247-56f0-902e-8e89226fbc2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL17880',
 'listing': 'auction',
 'location': 'DE, Hemau',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 67492,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img2f/22/2f22b56beec7ea5e60bcd206d7b79d93/pa/WL17880_50e42580c5b3fc7407e0dc0ad0bb4089.png',
                'https://img-pa.auto1.com/img2f/22/2f22b56beec7ea5e60bcd206d7b79d93/pa/WL17880_6ccc20ab30ce637777de53c7b6bf0eeb.png',
                'https://img-pa.auto1.com/img2f/22/2f22b56beec7ea5e60bcd206d7b79d93/pa/WL17880_0825cf98cf1e8886031235f7d92ebd4a.png',
                'https://img-pa.auto1.com/img2f/22/2f22b56beec7ea5e60bcd206d7b79d93/pa/WL17880_8e5447af8c0484667e47f81802db4b2e.png',
                'https://img-pa.auto1.com/img2f/22/2f22b56beec7ea5e60bcd206d7b79d93/pa/WL17880_100f9107568773eb3acf54207904d2aa.png',
                'https://img-pa.auto1.com/img2f/22/2f22b56beec7ea5e60bcd206d7b79d93/pa/WL17880_c7c0f8613178b5b78daedf081b6039db.jpg',
                'https://img-pa.auto1.com/img2f/22/2f22b56beec7ea5e60bcd206d7b79d93/pa/WL17880_8e100aebde7a2c315428a384d14fefee.jpg',
                'https://img-pa.auto1.com/img2f/22/2f22b56beec7ea5e60bcd206d7b79d93/pa/WL17880_90d01cc49f6e55cc1cd345ffaf85cc13.jpg',
                'https://img-pa.auto1.com/img2f/22/2f22b56beec7ea5e60bcd206d7b79d93/pa/WL17880_dadb9ca5d753adfb1a377eb2ffb222a2.jpg',
                'https://img-pa.auto1.com/img2f/22/2f22b56beec7ea5e60bcd206d7b79d93/pa/WL17880_3b00e9b8ab6ffe324d7c631a352860f6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14606920-0247-56f0-902e-8e89226fbc2f/14606920-0247-56f0-902e-8e89226fbc2f_image_0.png',
             'Extension': 'png',
             'FileSizeInBytes': 1081129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/22/2f22b56beec7ea5e60bcd206d7b79d93/pa/WL17880_50e42580c5b3fc7407e0dc0ad0bb4089.png',
             'Width': 769},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14606920-0247-56f0-902e-8e89226fbc2f/14606920-0247-56f0-902e-8e89226fbc2f_image_1.png',
             'Extension': 'png',
             'FileSizeInBytes': 1081129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/22/2f22b56beec7ea5e60bcd206d7b79d93/pa/WL17880_6ccc20ab30ce637777de53c7b6bf0eeb.png',
             'Width': 769},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14606920-0247-56f0-902e-8e89226fbc2f/14606920-0247-56f0-902e-8e89226fbc2f_image_2.png',
             'Extension': 'png',
             'FileSizeInBytes': 1063183,
             'Height': 577,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/22/2f22b56beec7ea5e60bcd206d7b79d93/pa/WL17880_0825cf98cf1e8886031235f7d92ebd4a.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14606920-0247-56f0-902e-8e89226fbc2f/14606920-0247-56f0-902e-8e89226fbc2f_image_3.png',
             'Extension': 'png',
             'FileSizeInBytes': 724783,
             'Height': 380,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/22/2f22b56beec7ea5e60bcd206d7b79d93/pa/WL17880_8e5447af8c0484667e47f81802db4b2e.png',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14606920-0247-56f0-902e-8e89226fbc2f/14606920-0247-56f0-902e-8e89226fbc2f_image_4.png',
             'Extension': 'png',
             'FileSizeInBytes': 821960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/22/2f22b56beec7ea5e60bcd206d7b79d93/pa/WL17880_100f9107568773eb3acf54207904d2aa.png',
             'Width': 685},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14606920-0247-56f0-902e-8e89226fbc2f/14606920-0247-56f0-902e-8e89226fbc2f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95913,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/22/2f22b56beec7ea5e60bcd206d7b79d93/pa/WL17880_c7c0f8613178b5b78daedf081b6039db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14606920-0247-56f0-902e-8e89226fbc2f/14606920-0247-56f0-902e-8e89226fbc2f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/22/2f22b56beec7ea5e60bcd206d7b79d93/pa/WL17880_8e100aebde7a2c315428a384d14fefee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14606920-0247-56f0-902e-8e89226fbc2f/14606920-0247-56f0-902e-8e89226fbc2f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95064,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/22/2f22b56beec7ea5e60bcd206d7b79d93/pa/WL17880_90d01cc49f6e55cc1cd345ffaf85cc13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14606920-0247-56f0-902e-8e89226fbc2f/14606920-0247-56f0-902e-8e89226fbc2f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50547,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/22/2f22b56beec7ea5e60bcd206d7b79d93/pa/WL17880_dadb9ca5d753adfb1a377eb2ffb222a2.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14606920-0247-56f0-902e-8e89226fbc2f/14606920-0247-56f0-902e-8e89226fbc2f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/22/2f22b56beec7ea5e60bcd206d7b79d93/pa/WL17880_3b00e9b8ab6ffe324d7c631a352860f6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-03-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 3.0 V6 TDI quattro Ambiente',
 'transmission': 'automatic',
 'trim': 'quattro Ambiente',
 'year': 2015}
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL17880%27 HTTP/1.1" 200 None
2026-03-29 10:37:26 [auto1.de] INFO: Saving data for WL17880: {'created_time': 1774780646.442904, 'last_price_update_time': 1774780646.442913, 'auction_closing_time': 1774883659.0}
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WL17880') HTTP/1.1" 204 0
2026-03-29 10:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f3d603a4-4f42-52c8-9e1a-71af0b203059 with identifier: WW76911
2026-03-29 10:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f3d603a4-4f42-52c8-9e1a-71af0b203059 with identifier: WW76911
2026-03-29 10:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f3d603a4-4f42-52c8-9e1a-71af0b203059 with identifier: WW76911 to the API
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WW76911>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:11:51Z',
 'fuel_type': 'petrol',
 'id': 'f3d603a4-4f42-52c8-9e1a-71af0b203059',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW76911',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 23531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img3d/6b/3d6ba89a8e90c63eba960c396e836a31/pa/WW76911_cc70878129a10db8cb219ea2f291199f.jpg',
                'https://img-pa.auto1.com/img3d/6b/3d6ba89a8e90c63eba960c396e836a31/pa/WW76911_a917e233e852491667802cd7dac0e440.jpg',
                'https://img-pa.auto1.com/img3d/6b/3d6ba89a8e90c63eba960c396e836a31/pa/WW76911_802bcb89413a6c57124680d157d48ad3.jpg',
                'https://img-pa.auto1.com/img3d/6b/3d6ba89a8e90c63eba960c396e836a31/pa/WW76911_e2955a2e1c426678d66c671f5abf32aa.jpg',
                'https://img-pa.auto1.com/img3d/6b/3d6ba89a8e90c63eba960c396e836a31/pa/WW76911_2f7bf3f5515da0573eeb5f3630a0e7c1.jpg',
                'https://img-pa.auto1.com/img3d/6b/3d6ba89a8e90c63eba960c396e836a31/pa/WW76911_db24986d600d16971da4c6a4eb544296.jpg',
                'https://img-pa.auto1.com/img3d/6b/3d6ba89a8e90c63eba960c396e836a31/pa/WW76911_2a00aa8e03487885a9fce29a4d4b2609.jpg',
                'https://img-pa.auto1.com/img3d/6b/3d6ba89a8e90c63eba960c396e836a31/pa/WW76911_3d1e25279cf139e22f38c9e818718129.jpg',
                'https://img-pa.auto1.com/img3d/6b/3d6ba89a8e90c63eba960c396e836a31/pa/WW76911_6b60b9cf7e6c75e7e31f28fdacc06ead.jpg',
                'https://img-pa.auto1.com/img3d/6b/3d6ba89a8e90c63eba960c396e836a31/pa/WW76911_400fbe5d2d8cefd9e5221f6c3df256a0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3d603a4-4f42-52c8-9e1a-71af0b203059/f3d603a4-4f42-52c8-9e1a-71af0b203059_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66552,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/6b/3d6ba89a8e90c63eba960c396e836a31/pa/WW76911_cc70878129a10db8cb219ea2f291199f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3d603a4-4f42-52c8-9e1a-71af0b203059/f3d603a4-4f42-52c8-9e1a-71af0b203059_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 147314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/6b/3d6ba89a8e90c63eba960c396e836a31/pa/WW76911_a917e233e852491667802cd7dac0e440.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3d603a4-4f42-52c8-9e1a-71af0b203059/f3d603a4-4f42-52c8-9e1a-71af0b203059_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 145293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/6b/3d6ba89a8e90c63eba960c396e836a31/pa/WW76911_802bcb89413a6c57124680d157d48ad3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3d603a4-4f42-52c8-9e1a-71af0b203059/f3d603a4-4f42-52c8-9e1a-71af0b203059_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 140158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/6b/3d6ba89a8e90c63eba960c396e836a31/pa/WW76911_e2955a2e1c426678d66c671f5abf32aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3d603a4-4f42-52c8-9e1a-71af0b203059/f3d603a4-4f42-52c8-9e1a-71af0b203059_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 145293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/6b/3d6ba89a8e90c63eba960c396e836a31/pa/WW76911_2f7bf3f5515da0573eeb5f3630a0e7c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3d603a4-4f42-52c8-9e1a-71af0b203059/f3d603a4-4f42-52c8-9e1a-71af0b203059_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/6b/3d6ba89a8e90c63eba960c396e836a31/pa/WW76911_db24986d600d16971da4c6a4eb544296.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3d603a4-4f42-52c8-9e1a-71af0b203059/f3d603a4-4f42-52c8-9e1a-71af0b203059_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 160348,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/6b/3d6ba89a8e90c63eba960c396e836a31/pa/WW76911_2a00aa8e03487885a9fce29a4d4b2609.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3d603a4-4f42-52c8-9e1a-71af0b203059/f3d603a4-4f42-52c8-9e1a-71af0b203059_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 160348,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/6b/3d6ba89a8e90c63eba960c396e836a31/pa/WW76911_3d1e25279cf139e22f38c9e818718129.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3d603a4-4f42-52c8-9e1a-71af0b203059/f3d603a4-4f42-52c8-9e1a-71af0b203059_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 173975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/6b/3d6ba89a8e90c63eba960c396e836a31/pa/WW76911_6b60b9cf7e6c75e7e31f28fdacc06ead.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f3d603a4-4f42-52c8-9e1a-71af0b203059/f3d603a4-4f42-52c8-9e1a-71af0b203059_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61819,
             'Height': 533,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/6b/3d6ba89a8e90c63eba960c396e836a31/pa/WW76911_400fbe5d2d8cefd9e5221f6c3df256a0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.5 TSI ACT Monte Carlo',
 'transmission': 'automatic',
 'trim': 'Monte Carlo',
 'year': 2023}
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW76911%27 HTTP/1.1" 200 None
2026-03-29 10:37:26 [auto1.de] INFO: Saving data for WW76911: {'created_time': 1774780646.863743, 'last_price_update_time': 1774780646.863753, 'auction_closing_time': 1774883511.0}
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW76911') HTTP/1.1" 204 0
2026-03-29 10:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6a23ac0-277f-541d-a641-0d8b78e6919d with identifier: NY52199
2026-03-29 10:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6a23ac0-277f-541d-a641-0d8b78e6919d with identifier: NY52199
2026-03-29 10:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6a23ac0-277f-541d-a641-0d8b78e6919d with identifier: NY52199 to the API
2026-03-29 10:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NY52199>
{'auction_title': '',
 'c_o_2_emission_value': 18,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 398,
 'expiration_date': '2026-03-30T15:37:02Z',
 'fuel_type': 'hybrid',
 'id': 'b6a23ac0-277f-541d-a641-0d8b78e6919d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY52199',
 'listing': 'auction',
 'location': 'DE, Hemau',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 54058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img30/b7/30b7672e7318387755de62e07b6bdb88/pa/NY52199_4b2c13c329e3e603b71528be99591150.jpg',
                'https://img-pa.auto1.com/img30/b7/30b7672e7318387755de62e07b6bdb88/pa/NY52199_e1b1f56e91dbb2aa6030bffe116cc11d.jpg',
                'https://img-pa.auto1.com/img30/b7/30b7672e7318387755de62e07b6bdb88/pa/NY52199_11af5da679d906cb0bf9ff2d4c62a376.jpg',
                'https://img-pa.auto1.com/img30/b7/30b7672e7318387755de62e07b6bdb88/pa/NY52199_75d8d6d9bd15263d319ec612ddd8548c.jpg',
                'https://img-pa.auto1.com/img30/b7/30b7672e7318387755de62e07b6bdb88/pa/NY52199_9be94df88eacf5e50e1d3cd8f6ead781.jpg',
                'https://img-pa.auto1.com/img30/b7/30b7672e7318387755de62e07b6bdb88/pa/NY52199_9c2b2c931a3a16a1e3b6fe0fc70b48c2.jpg',
                'https://img-pa.auto1.com/img30/b7/30b7672e7318387755de62e07b6bdb88/pa/NY52199_2075c9424aa3b85c483cd966c1e68cbc.jpg',
                'https://img-pa.auto1.com/img30/b7/30b7672e7318387755de62e07b6bdb88/pa/NY52199_ede030e39f907f26685313a0d38d3134.jpg',
                'https://img-pa.auto1.com/img30/b7/30b7672e7318387755de62e07b6bdb88/pa/NY52199_bbd823acb7fd6970ef84cbc5684c0961.jpg',
                'https://img-pa.auto1.com/img30/b7/30b7672e7318387755de62e07b6bdb88/pa/NY52199_465c9496e65f9d3e9991870b48f69d72.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6a23ac0-277f-541d-a641-0d8b78e6919d/b6a23ac0-277f-541d-a641-0d8b78e6919d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/b7/30b7672e7318387755de62e07b6bdb88/pa/NY52199_4b2c13c329e3e603b71528be99591150.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6a23ac0-277f-541d-a641-0d8b78e6919d/b6a23ac0-277f-541d-a641-0d8b78e6919d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/b7/30b7672e7318387755de62e07b6bdb88/pa/NY52199_e1b1f56e91dbb2aa6030bffe116cc11d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6a23ac0-277f-541d-a641-0d8b78e6919d/b6a23ac0-277f-541d-a641-0d8b78e6919d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/b7/30b7672e7318387755de62e07b6bdb88/pa/NY52199_11af5da679d906cb0bf9ff2d4c62a376.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6a23ac0-277f-541d-a641-0d8b78e6919d/b6a23ac0-277f-541d-a641-0d8b78e6919d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67237,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/b7/30b7672e7318387755de62e07b6bdb88/pa/NY52199_75d8d6d9bd15263d319ec612ddd8548c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6a23ac0-277f-541d-a641-0d8b78e6919d/b6a23ac0-277f-541d-a641-0d8b78e6919d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/b7/30b7672e7318387755de62e07b6bdb88/pa/NY52199_9be94df88eacf5e50e1d3cd8f6ead781.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6a23ac0-277f-541d-a641-0d8b78e6919d/b6a23ac0-277f-541d-a641-0d8b78e6919d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/b7/30b7672e7318387755de62e07b6bdb88/pa/NY52199_9c2b2c931a3a16a1e3b6fe0fc70b48c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6a23ac0-277f-541d-a641-0d8b78e6919d/b6a23ac0-277f-541d-a641-0d8b78e6919d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/b7/30b7672e7318387755de62e07b6bdb88/pa/NY52199_2075c9424aa3b85c483cd966c1e68cbc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6a23ac0-277f-541d-a641-0d8b78e6919d/b6a23ac0-277f-541d-a641-0d8b78e6919d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72846,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/b7/30b7672e7318387755de62e07b6bdb88/pa/NY52199_ede030e39f907f26685313a0d38d3134.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6a23ac0-277f-541d-a641-0d8b78e6919d/b6a23ac0-277f-541d-a641-0d8b78e6919d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/b7/30b7672e7318387755de62e07b6bdb88/pa/NY52199_bbd823acb7fd6970ef84cbc5684c0961.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6a23ac0-277f-541d-a641-0d8b78e6919d/b6a23ac0-277f-541d-a641-0d8b78e6919d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95284,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/b7/30b7672e7318387755de62e07b6bdb88/pa/NY52199_465c9496e65f9d3e9991870b48f69d72.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V60 2.0 T6 Recharge Plug-in Hybrid Core AWD',
 'transmission': 'automatic',
 'trim': 'Core AWD',
 'year': 2022}
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY52199%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Saving data for NY52199: {'created_time': 1774780647.202119, 'last_price_update_time': 1774780647.202129, 'auction_closing_time': 1774885022.0}
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY52199') HTTP/1.1" 204 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: VJ55974
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: YP11119
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: MC32966
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: GE22934
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE22934%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for GE22934: 2
2026-03-29 10:37:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47f8be1c-e36a-594b-a77d-d3cba666b44b with identifier: GE22934
2026-03-29 10:37:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47f8be1c-e36a-594b-a77d-d3cba666b44b with scrape type 2
2026-03-29 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47f8be1c-e36a-594b-a77d-d3cba666b44b with scrape type 2
2026-03-29 10:37:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47f8be1c-e36a-594b-a77d-d3cba666b44b, identifier: GE22934
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: UB19219
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB19219%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for UB19219: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: SH98568
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: FU56159
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: HP87515
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: VE03726
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: SJ83553
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: NG98905
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG98905%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for NG98905: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: VC98877
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: JC07133
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC07133%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for JC07133: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: JR52924
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR52924%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for JR52924: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: GL55365
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: MU38011
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU38011%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for MU38011: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: GM39396
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: KM60144
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM60144%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for KM60144: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: KP76789
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP76789%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for KP76789: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: YU84960
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: KM84276
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM84276%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for KM84276: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: WJ57335
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: HK49782
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: JT65336
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: UM76387
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM76387%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for UM76387: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: BR88683
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: PY66131
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: WX96485
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX96485%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for WX96485: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: AL04579
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: NH10753
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: CA14151
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: EF04397
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: BY37084
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY37084%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for BY37084: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: GC63965
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC63965%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for GC63965: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: UA30528
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA30528%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for UA30528: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: PP86111
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: AF40281
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF40281%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for AF40281: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: AU99703
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: UJ07162
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: YV92261
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV92261%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for YV92261: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: YG24433
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG24433%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for YG24433: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: RK19274
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK19274%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for RK19274: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: XP45109
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP45109%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for XP45109: 0
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: UB06797
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB06797%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for UB06797: 0
2026-03-29 10:37:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:27 [auto1.de] INFO: Found listing with ID: ST83220
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST83220%27 HTTP/1.1" 200 None
2026-03-29 10:37:27 [auto1.de] INFO: Scrape type for ST83220: 2
2026-03-29 10:37:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c69efc6-b574-5e0e-a059-24a1546697ce with identifier: ST83220
2026-03-29 10:37:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c69efc6-b574-5e0e-a059-24a1546697ce with scrape type 2
2026-03-29 10:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c69efc6-b574-5e0e-a059-24a1546697ce with scrape type 2
2026-03-29 10:37:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c69efc6-b574-5e0e-a059-24a1546697ce, identifier: ST83220
2026-03-29 10:37:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47f8be1c-e36a-594b-a77d-d3cba666b44b with identifier: GE22934
2026-03-29 10:37:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47f8be1c-e36a-594b-a77d-d3cba666b44b with identifier: GE22934
2026-03-29 10:37:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47f8be1c-e36a-594b-a77d-d3cba666b44b with identifier: GE22934 to the API
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 305,
 'expiration_date': '2026-03-30T15:09:21Z',
 'fuel_type': 'diesel',
 'id': '47f8be1c-e36a-594b-a77d-d3cba666b44b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE22934',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X6',
 'odometer': 141266,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-28',
 'seller_name': None,
 'title': 'BMW X6 xDrive 40d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-29 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE22934%27 HTTP/1.1" 200 None
2026-03-29 10:37:28 [auto1.de] INFO: Saving data for GE22934: {'auction_closing_time': 1774883361.0, 'created_time': 1773381191.616447, 'last_price_update_time': 1774780648.089199}
2026-03-29 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE22934') HTTP/1.1" 204 0
2026-03-29 10:37:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c69efc6-b574-5e0e-a059-24a1546697ce with identifier: ST83220
2026-03-29 10:37:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c69efc6-b574-5e0e-a059-24a1546697ce with identifier: ST83220
2026-03-29 10:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c69efc6-b574-5e0e-a059-24a1546697ce with identifier: ST83220 to the API
2026-03-29 10:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:28:31Z',
 'fuel_type': 'diesel',
 'id': '0c69efc6-b574-5e0e-a059-24a1546697ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST83220',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Kombi',
 'odometer': 208857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-11',
 'seller_name': None,
 'title': 'Volkswagen T6 Kombi 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-03-29 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST83220%27 HTTP/1.1" 200 None
2026-03-29 10:37:28 [auto1.de] INFO: Saving data for ST83220: {'auction_closing_time': 1774884511.0, 'created_time': 1774550688.906531, 'last_price_update_time': 1774780648.513792}
2026-03-29 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ST83220') HTTP/1.1" 204 0
2026-03-29 10:37:28 [auto1.de] INFO: Found listing with ID: FB20654
2026-03-29 10:37:28 [auto1.de] INFO: Found listing with ID: GM09493
2026-03-29 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM09493%27 HTTP/1.1" 200 None
2026-03-29 10:37:28 [auto1.de] INFO: Scrape type for GM09493: 2
2026-03-29 10:37:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 945a5e16-5224-54fb-b19b-ae707151d7b3 with identifier: GM09493
2026-03-29 10:37:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 945a5e16-5224-54fb-b19b-ae707151d7b3 with scrape type 2
2026-03-29 10:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 945a5e16-5224-54fb-b19b-ae707151d7b3 with scrape type 2
2026-03-29 10:37:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 945a5e16-5224-54fb-b19b-ae707151d7b3, identifier: GM09493
2026-03-29 10:37:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 945a5e16-5224-54fb-b19b-ae707151d7b3 with identifier: GM09493
2026-03-29 10:37:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 945a5e16-5224-54fb-b19b-ae707151d7b3 with identifier: GM09493
2026-03-29 10:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 945a5e16-5224-54fb-b19b-ae707151d7b3 with identifier: GM09493 to the API
2026-03-29 10:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:09:20Z',
 'fuel_type': 'petrol',
 'id': '945a5e16-5224-54fb-b19b-ae707151d7b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM09493',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 24199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-09',
 'seller_name': None,
 'title': 'MINI Countryman One',
 'transmission': 'manual',
 'trim': '',
 'year': 2021}
2026-03-29 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM09493%27 HTTP/1.1" 200 None
2026-03-29 10:37:28 [auto1.de] INFO: Saving data for GM09493: {'auction_closing_time': 1774883360.0, 'created_time': 1774379384.953606, 'last_price_update_time': 1774780648.938074}
2026-03-29 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM09493') HTTP/1.1" 204 0
2026-03-29 10:37:28 [auto1.de] INFO: Found listing with ID: UZ05424
2026-03-29 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ05424%27 HTTP/1.1" 200 None
2026-03-29 10:37:28 [auto1.de] INFO: Scrape type for UZ05424: 2
2026-03-29 10:37:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce477fc1-fd47-5740-90a4-229aaee97690 with identifier: UZ05424
2026-03-29 10:37:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce477fc1-fd47-5740-90a4-229aaee97690 with scrape type 2
2026-03-29 10:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce477fc1-fd47-5740-90a4-229aaee97690 with scrape type 2
2026-03-29 10:37:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce477fc1-fd47-5740-90a4-229aaee97690, identifier: UZ05424
2026-03-29 10:37:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce477fc1-fd47-5740-90a4-229aaee97690 with identifier: UZ05424
2026-03-29 10:37:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce477fc1-fd47-5740-90a4-229aaee97690 with identifier: UZ05424
2026-03-29 10:37:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce477fc1-fd47-5740-90a4-229aaee97690 with identifier: UZ05424 to the API
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-30T15:22:37Z',
 'fuel_type': 'diesel',
 'id': 'ce477fc1-fd47-5740-90a4-229aaee97690',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ05424',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 67882,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-10',
 'seller_name': None,
 'title': 'Audi A6 45 TDI Mild-Hybrid quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ05424%27 HTTP/1.1" 200 None
2026-03-29 10:37:29 [auto1.de] INFO: Saving data for UZ05424: {'auction_closing_time': 1774884157.0, 'created_time': 1774465813.967316, 'last_price_update_time': 1774780649.402413}
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ05424') HTTP/1.1" 204 0
2026-03-29 10:37:29 [auto1.de] INFO: Found listing with ID: FA50226
2026-03-29 10:37:29 [auto1.de] INFO: Found listing with ID: AY40999
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY40999%27 HTTP/1.1" 200 None
2026-03-29 10:37:29 [auto1.de] INFO: Scrape type for AY40999: 2
2026-03-29 10:37:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 495f2792-7a8e-5428-ba58-531800124e3b with identifier: AY40999
2026-03-29 10:37:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 495f2792-7a8e-5428-ba58-531800124e3b with scrape type 2
2026-03-29 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 495f2792-7a8e-5428-ba58-531800124e3b with scrape type 2
2026-03-29 10:37:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 495f2792-7a8e-5428-ba58-531800124e3b, identifier: AY40999
2026-03-29 10:37:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 495f2792-7a8e-5428-ba58-531800124e3b with identifier: AY40999
2026-03-29 10:37:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 495f2792-7a8e-5428-ba58-531800124e3b with identifier: AY40999
2026-03-29 10:37:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 495f2792-7a8e-5428-ba58-531800124e3b with identifier: AY40999 to the API
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:00:56Z',
 'fuel_type': 'diesel',
 'id': '495f2792-7a8e-5428-ba58-531800124e3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY40999',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 144829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-18',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2017}
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY40999%27 HTTP/1.1" 200 None
2026-03-29 10:37:29 [auto1.de] INFO: Saving data for AY40999: {'auction_closing_time': 1774882856.0, 'created_time': 1774379443.213474, 'last_price_update_time': 1774780649.905487}
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AY40999') HTTP/1.1" 204 0
2026-03-29 10:37:29 [auto1.de] INFO: Found listing with ID: SY89352
2026-03-29 10:37:29 [auto1.de] INFO: Found listing with ID: YE79096
2026-03-29 10:37:29 [auto1.de] INFO: Found listing with ID: XG44569
2026-03-29 10:37:29 [auto1.de] INFO: Found listing with ID: XZ28453
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ28453%27 HTTP/1.1" 200 None
2026-03-29 10:37:29 [auto1.de] INFO: Scrape type for XZ28453: 2
2026-03-29 10:37:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7cd7cd0-aaac-5d43-9852-8ae13effb70e with identifier: XZ28453
2026-03-29 10:37:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7cd7cd0-aaac-5d43-9852-8ae13effb70e with scrape type 2
2026-03-29 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7cd7cd0-aaac-5d43-9852-8ae13effb70e with scrape type 2
2026-03-29 10:37:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7cd7cd0-aaac-5d43-9852-8ae13effb70e, identifier: XZ28453
2026-03-29 10:37:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7cd7cd0-aaac-5d43-9852-8ae13effb70e with identifier: XZ28453
2026-03-29 10:37:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7cd7cd0-aaac-5d43-9852-8ae13effb70e with identifier: XZ28453
2026-03-29 10:37:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7cd7cd0-aaac-5d43-9852-8ae13effb70e with identifier: XZ28453 to the API
2026-03-29 10:37:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:32:14Z',
 'fuel_type': 'diesel',
 'id': 'd7cd7cd0-aaac-5d43-9852-8ae13effb70e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ28453',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 134581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-08',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Multivan Generation Six 4Motion',
 'transmission': 'automatic',
 'trim': 'Multivan Generation Six 4Motion',
 'year': 2017}
2026-03-29 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ28453%27 HTTP/1.1" 200 None
2026-03-29 10:37:30 [auto1.de] INFO: Saving data for XZ28453: {'auction_closing_time': 1774884734.0, 'created_time': 1774379056.744329, 'last_price_update_time': 1774780650.452826}
2026-03-29 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ28453') HTTP/1.1" 204 0
2026-03-29 10:37:30 [auto1.de] INFO: Found listing with ID: EE17704
2026-03-29 10:37:30 [auto1.de] INFO: Found listing with ID: TU83885
2026-03-29 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU83885%27 HTTP/1.1" 200 None
2026-03-29 10:37:30 [auto1.de] INFO: Scrape type for TU83885: 2
2026-03-29 10:37:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 494a889c-62bf-57d5-8125-d0ac8bc1ed9e with identifier: TU83885
2026-03-29 10:37:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 494a889c-62bf-57d5-8125-d0ac8bc1ed9e with scrape type 2
2026-03-29 10:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 494a889c-62bf-57d5-8125-d0ac8bc1ed9e with scrape type 2
2026-03-29 10:37:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 494a889c-62bf-57d5-8125-d0ac8bc1ed9e, identifier: TU83885
2026-03-29 10:37:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 494a889c-62bf-57d5-8125-d0ac8bc1ed9e with identifier: TU83885
2026-03-29 10:37:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 494a889c-62bf-57d5-8125-d0ac8bc1ed9e with identifier: TU83885
2026-03-29 10:37:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 494a889c-62bf-57d5-8125-d0ac8bc1ed9e with identifier: TU83885 to the API
2026-03-29 10:37:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:49:57Z',
 'fuel_type': 'petrol',
 'id': '494a889c-62bf-57d5-8125-d0ac8bc1ed9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU83885',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 228422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-06',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TSI Comfortline lang',
 'transmission': 'automatic',
 'trim': 'Comfortline lang',
 'year': 2018}
2026-03-29 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU83885%27 HTTP/1.1" 200 None
2026-03-29 10:37:30 [auto1.de] INFO: Saving data for TU83885: {'auction_closing_time': 1774885797.0, 'created_time': 1773380838.095643, 'last_price_update_time': 1774780650.968759}
2026-03-29 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU83885') HTTP/1.1" 204 0
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: ZU14307
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU14307%27 HTTP/1.1" 200 None
2026-03-29 10:37:31 [auto1.de] INFO: Scrape type for ZU14307: 2
2026-03-29 10:37:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e9e5cd9-d6fe-5ade-98ba-3e5ddbff171b with identifier: ZU14307
2026-03-29 10:37:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e9e5cd9-d6fe-5ade-98ba-3e5ddbff171b with scrape type 2
2026-03-29 10:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e9e5cd9-d6fe-5ade-98ba-3e5ddbff171b with scrape type 2
2026-03-29 10:37:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e9e5cd9-d6fe-5ade-98ba-3e5ddbff171b, identifier: ZU14307
2026-03-29 10:37:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e9e5cd9-d6fe-5ade-98ba-3e5ddbff171b with identifier: ZU14307
2026-03-29 10:37:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e9e5cd9-d6fe-5ade-98ba-3e5ddbff171b with identifier: ZU14307
2026-03-29 10:37:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e9e5cd9-d6fe-5ade-98ba-3e5ddbff171b with identifier: ZU14307 to the API
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:23:49Z',
 'fuel_type': 'diesel',
 'id': '3e9e5cd9-d6fe-5ade-98ba-3e5ddbff171b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU14307',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 81461,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-03',
 'seller_name': None,
 'title': 'Audi Q3 35 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU14307%27 HTTP/1.1" 200 None
2026-03-29 10:37:31 [auto1.de] INFO: Saving data for ZU14307: {'auction_closing_time': 1774884229.0, 'created_time': 1773831103.484913, 'last_price_update_time': 1774780651.966177}
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU14307') HTTP/1.1" 204 0
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: WT63610
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: GD86800
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: MT90206
2026-03-29 10:37:31 [auto1.de] INFO: Found listing with ID: EH26353
2026-03-29 10:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH26353%27 HTTP/1.1" 200 None
2026-03-29 10:37:32 [auto1.de] INFO: Scrape type for EH26353: 2
2026-03-29 10:37:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19a0eafb-7f20-599e-9ee4-63552a59b5a5 with identifier: EH26353
2026-03-29 10:37:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19a0eafb-7f20-599e-9ee4-63552a59b5a5 with scrape type 2
2026-03-29 10:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19a0eafb-7f20-599e-9ee4-63552a59b5a5 with scrape type 2
2026-03-29 10:37:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19a0eafb-7f20-599e-9ee4-63552a59b5a5, identifier: EH26353
2026-03-29 10:37:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19a0eafb-7f20-599e-9ee4-63552a59b5a5 with identifier: EH26353
2026-03-29 10:37:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19a0eafb-7f20-599e-9ee4-63552a59b5a5 with identifier: EH26353
2026-03-29 10:37:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19a0eafb-7f20-599e-9ee4-63552a59b5a5 with identifier: EH26353 to the API
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:51:43Z',
 'fuel_type': 'petrol',
 'id': '19a0eafb-7f20-599e-9ee4-63552a59b5a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH26353',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Limousine',
 'odometer': 32387,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-24',
 'seller_name': None,
 'title': 'Audi A3 Limousine 35 TFSI Mild-Hybrid S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2022}
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH26353%27 HTTP/1.1" 200 None
2026-03-29 10:37:32 [auto1.de] INFO: Saving data for EH26353: {'auction_closing_time': 1774885903.0, 'created_time': 1773380586.550223, 'last_price_update_time': 1774780652.395339}
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EH26353') HTTP/1.1" 204 0
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: TU83793
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU83793%27 HTTP/1.1" 200 None
2026-03-29 10:37:32 [auto1.de] INFO: Scrape type for TU83793: 2
2026-03-29 10:37:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 281514de-9464-560f-9eff-f973e58c2390 with identifier: TU83793
2026-03-29 10:37:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 281514de-9464-560f-9eff-f973e58c2390 with scrape type 2
2026-03-29 10:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 281514de-9464-560f-9eff-f973e58c2390 with scrape type 2
2026-03-29 10:37:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 281514de-9464-560f-9eff-f973e58c2390, identifier: TU83793
2026-03-29 10:37:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 281514de-9464-560f-9eff-f973e58c2390 with identifier: TU83793
2026-03-29 10:37:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 281514de-9464-560f-9eff-f973e58c2390 with identifier: TU83793
2026-03-29 10:37:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 281514de-9464-560f-9eff-f973e58c2390 with identifier: TU83793 to the API
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-30T15:00:55Z',
 'fuel_type': 'diesel',
 'id': '281514de-9464-560f-9eff-f973e58c2390',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU83793',
 'listing': 'auction',
 'make': 'BMW',
 'model': '6er',
 'odometer': 188594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-27',
 'seller_name': None,
 'title': 'BMW 6er 640d Gran Coupé xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2014}
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU83793%27 HTTP/1.1" 200 None
2026-03-29 10:37:32 [auto1.de] INFO: Saving data for TU83793: {'auction_closing_time': 1774882855.0, 'created_time': 1774034893.524327, 'last_price_update_time': 1774780652.857544}
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU83793') HTTP/1.1" 204 0
2026-03-29 10:37:32 [auto1.de] INFO: Found listing with ID: FL70928
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL70928%27 HTTP/1.1" 200 None
2026-03-29 10:37:32 [auto1.de] INFO: Scrape type for FL70928: 2
2026-03-29 10:37:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d9f80fc-e69c-57f8-a3cb-01d28456e344 with identifier: FL70928
2026-03-29 10:37:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d9f80fc-e69c-57f8-a3cb-01d28456e344 with scrape type 2
2026-03-29 10:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d9f80fc-e69c-57f8-a3cb-01d28456e344 with scrape type 2
2026-03-29 10:37:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d9f80fc-e69c-57f8-a3cb-01d28456e344, identifier: FL70928
2026-03-29 10:37:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d9f80fc-e69c-57f8-a3cb-01d28456e344 with identifier: FL70928
2026-03-29 10:37:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d9f80fc-e69c-57f8-a3cb-01d28456e344 with identifier: FL70928
2026-03-29 10:37:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d9f80fc-e69c-57f8-a3cb-01d28456e344 with identifier: FL70928 to the API
2026-03-29 10:37:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 241,
 'expiration_date': '2026-03-30T15:28:23Z',
 'fuel_type': 'diesel',
 'id': '8d9f80fc-e69c-57f8-a3cb-01d28456e344',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL70928',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Defender',
 'odometer': 104410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-08',
 'seller_name': None,
 'title': 'Land Rover Defender D240 110 SE',
 'transmission': 'automatic',
 'trim': '110 SE',
 'year': 2020}
2026-03-29 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL70928%27 HTTP/1.1" 200 None
2026-03-29 10:37:33 [auto1.de] INFO: Saving data for FL70928: {'auction_closing_time': 1774884503.0, 'created_time': 1774550382.532324, 'last_price_update_time': 1774780653.292161}
2026-03-29 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FL70928') HTTP/1.1" 204 0
2026-03-29 10:37:33 [auto1.de] INFO: Found listing with ID: KS19016
2026-03-29 10:37:33 [auto1.de] INFO: Found listing with ID: ZU61192
2026-03-29 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU61192%27 HTTP/1.1" 200 None
2026-03-29 10:37:33 [auto1.de] INFO: Scrape type for ZU61192: 0
2026-03-29 10:37:33 [auto1.de] INFO: Found listing with ID: UT35325
2026-03-29 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT35325%27 HTTP/1.1" 200 None
2026-03-29 10:37:33 [auto1.de] INFO: Scrape type for UT35325: 0
2026-03-29 10:37:33 [auto1.de] INFO: Found listing with ID: PY62114
2026-03-29 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY62114%27 HTTP/1.1" 200 None
2026-03-29 10:37:33 [auto1.de] INFO: Scrape type for PY62114: 0
2026-03-29 10:37:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WP80129/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:33 [auto1.de] INFO: Channel: 24h | Page: 12 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:33 [auto1.de] INFO: Found listing with ID: HL50945
2026-03-29 10:37:33 [auto1.de] INFO: Found listing with ID: BM44177
2026-03-29 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM44177%27 HTTP/1.1" 200 None
2026-03-29 10:37:33 [auto1.de] INFO: Scrape type for BM44177: 0
2026-03-29 10:37:33 [auto1.de] INFO: Found listing with ID: JE28257
2026-03-29 10:37:33 [auto1.de] INFO: Found listing with ID: TK71200
2026-03-29 10:37:33 [auto1.de] INFO: Found listing with ID: EZ46252
2026-03-29 10:37:33 [auto1.de] INFO: Found listing with ID: AK88220
2026-03-29 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK88220%27 HTTP/1.1" 200 None
2026-03-29 10:37:33 [auto1.de] INFO: Scrape type for AK88220: 0
2026-03-29 10:37:33 [auto1.de] INFO: Found listing with ID: DN40523
2026-03-29 10:37:33 [auto1.de] INFO: Found listing with ID: XJ45397
2026-03-29 10:37:33 [auto1.de] INFO: Found listing with ID: UP49415
2026-03-29 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP49415%27 HTTP/1.1" 200 None
2026-03-29 10:37:33 [auto1.de] INFO: Scrape type for UP49415: 0
2026-03-29 10:37:33 [auto1.de] INFO: Found listing with ID: TM91896
2026-03-29 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM91896%27 HTTP/1.1" 200 None
2026-03-29 10:37:33 [auto1.de] INFO: Scrape type for TM91896: 0
2026-03-29 10:37:33 [auto1.de] INFO: Found listing with ID: TZ55203
2026-03-29 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ55203%27 HTTP/1.1" 200 None
2026-03-29 10:37:33 [auto1.de] INFO: Scrape type for TZ55203: 0
2026-03-29 10:37:33 [auto1.de] INFO: Found listing with ID: NR32079
2026-03-29 10:37:33 [auto1.de] INFO: Found listing with ID: XW83383
2026-03-29 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW83383%27 HTTP/1.1" 200 None
2026-03-29 10:37:33 [auto1.de] INFO: Scrape type for XW83383: 0
2026-03-29 10:37:33 [auto1.de] INFO: Found listing with ID: DN59974
2026-03-29 10:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN59974%27 HTTP/1.1" 200 None
2026-03-29 10:37:34 [auto1.de] INFO: Scrape type for DN59974: 0
2026-03-29 10:37:34 [auto1.de] INFO: Found listing with ID: TH47484
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH47484%27 HTTP/1.1" 200 None
2026-03-29 10:37:34 [auto1.de] INFO: Scrape type for TH47484: 0
2026-03-29 10:37:34 [auto1.de] INFO: Found listing with ID: ST09245
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST09245%27 HTTP/1.1" 200 None
2026-03-29 10:37:34 [auto1.de] INFO: Scrape type for ST09245: 0
2026-03-29 10:37:34 [auto1.de] INFO: Found listing with ID: TK97766
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK97766%27 HTTP/1.1" 200 None
2026-03-29 10:37:34 [auto1.de] INFO: Scrape type for TK97766: 0
2026-03-29 10:37:34 [auto1.de] INFO: Found listing with ID: GZ01520
2026-03-29 10:37:34 [auto1.de] INFO: Found listing with ID: PD79431
2026-03-29 10:37:34 [auto1.de] INFO: Found listing with ID: RS30445
2026-03-29 10:37:34 [auto1.de] INFO: Found listing with ID: VN22748
2026-03-29 10:37:34 [auto1.de] INFO: Found listing with ID: BK28670
2026-03-29 10:37:34 [auto1.de] INFO: Found listing with ID: AK90767
2026-03-29 10:37:34 [auto1.de] INFO: Found listing with ID: TB02108
2026-03-29 10:37:34 [auto1.de] INFO: Found listing with ID: GB27698
2026-03-29 10:37:34 [auto1.de] INFO: Found listing with ID: YC23372
2026-03-29 10:37:34 [auto1.de] INFO: Found listing with ID: LN26385
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN26385%27 HTTP/1.1" 200 None
2026-03-29 10:37:34 [auto1.de] INFO: Scrape type for LN26385: 0
2026-03-29 10:37:34 [auto1.de] INFO: Found listing with ID: WA11944
2026-03-29 10:37:34 [auto1.de] INFO: Found listing with ID: VA77092
2026-03-29 10:37:34 [auto1.de] INFO: Found listing with ID: SR72775
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR72775%27 HTTP/1.1" 200 None
2026-03-29 10:37:34 [auto1.de] INFO: Scrape type for SR72775: 0
2026-03-29 10:37:34 [auto1.de] INFO: Found listing with ID: JZ29670
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ29670%27 HTTP/1.1" 200 None
2026-03-29 10:37:34 [auto1.de] INFO: Scrape type for JZ29670: 0
2026-03-29 10:37:34 [auto1.de] INFO: Found listing with ID: LW90225
2026-03-29 10:37:34 [auto1.de] INFO: Found listing with ID: LJ23138
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ23138%27 HTTP/1.1" 200 None
2026-03-29 10:37:34 [auto1.de] INFO: Scrape type for LJ23138: 0
2026-03-29 10:37:34 [auto1.de] INFO: Found listing with ID: VZ47534
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ47534%27 HTTP/1.1" 200 None
2026-03-29 10:37:34 [auto1.de] INFO: Scrape type for VZ47534: 0
2026-03-29 10:37:34 [auto1.de] INFO: Found listing with ID: ZA27483
2026-03-29 10:37:34 [auto1.de] INFO: Found listing with ID: HY14352
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY14352%27 HTTP/1.1" 200 None
2026-03-29 10:37:34 [auto1.de] INFO: Scrape type for HY14352: 0
2026-03-29 10:37:34 [auto1.de] INFO: Found listing with ID: XM73112
2026-03-29 10:37:34 [auto1.de] INFO: Found listing with ID: JD41613
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD41613%27 HTTP/1.1" 200 None
2026-03-29 10:37:34 [auto1.de] INFO: Scrape type for JD41613: 0
2026-03-29 10:37:34 [auto1.de] INFO: Found listing with ID: EA70059
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA70059%27 HTTP/1.1" 200 None
2026-03-29 10:37:34 [auto1.de] INFO: Scrape type for EA70059: 0
2026-03-29 10:37:34 [auto1.de] INFO: Found listing with ID: VY06306
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY06306%27 HTTP/1.1" 200 None
2026-03-29 10:37:34 [auto1.de] INFO: Scrape type for VY06306: 0
2026-03-29 10:37:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WP80129> (referer: https://www.auto1.com/v1/car-details-view/WP80129/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7ae5b31-c19d-5234-9d07-76449a71f39a with identifier: WP80129
2026-03-29 10:37:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7ae5b31-c19d-5234-9d07-76449a71f39a with scrape type 1
2026-03-29 10:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e7ae5b31-c19d-5234-9d07-76449a71f39a
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F86%252Fb0869317f407fb01bf7bad7a055b6697%252Fpa%252FWP80129_99d7e783fd7d4729dd1d728b90908ddd.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/86/b0869317f407fb01bf7bad7a055b6697/pa/WP80129_99d7e783fd7d4729dd1d728b90908ddd.jpg already downloaded
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F86%252Fb0869317f407fb01bf7bad7a055b6697%252Fpa%252FWP80129_7ecf09d7521d21ab01d23087081508b9.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/86/b0869317f407fb01bf7bad7a055b6697/pa/WP80129_7ecf09d7521d21ab01d23087081508b9.jpg already downloaded
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F86%252Fb0869317f407fb01bf7bad7a055b6697%252Fpa%252FWP80129_a9c789a6eab80a2e4e32a8011a31efe5.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/86/b0869317f407fb01bf7bad7a055b6697/pa/WP80129_a9c789a6eab80a2e4e32a8011a31efe5.jpg already downloaded
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F86%252Fb0869317f407fb01bf7bad7a055b6697%252Fpa%252FWP80129_1eece0f4e97c460f92f3067d7b0db738.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/86/b0869317f407fb01bf7bad7a055b6697/pa/WP80129_1eece0f4e97c460f92f3067d7b0db738.jpg already downloaded
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F86%252Fb0869317f407fb01bf7bad7a055b6697%252Fpa%252FWP80129_3c4722a07bdc0641eb2ab82f35f1e861.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/86/b0869317f407fb01bf7bad7a055b6697/pa/WP80129_3c4722a07bdc0641eb2ab82f35f1e861.jpg already downloaded
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F86%252Fb0869317f407fb01bf7bad7a055b6697%252Fpa%252FWP80129_48624f380f32a465132cdc2d76fb61b4.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/86/b0869317f407fb01bf7bad7a055b6697/pa/WP80129_48624f380f32a465132cdc2d76fb61b4.jpg already downloaded
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F86%252Fb0869317f407fb01bf7bad7a055b6697%252Fpa%252FWP80129_63538867302838ee025e2281cc2b1429.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/86/b0869317f407fb01bf7bad7a055b6697/pa/WP80129_63538867302838ee025e2281cc2b1429.jpg already downloaded
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F86%252Fb0869317f407fb01bf7bad7a055b6697%252Fpa%252FWP80129_5646579140b79c94e1e2a4318ecfa5ef.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/86/b0869317f407fb01bf7bad7a055b6697/pa/WP80129_5646579140b79c94e1e2a4318ecfa5ef.jpg already downloaded
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F86%252Fb0869317f407fb01bf7bad7a055b6697%252Fpa%252FWP80129_8cea6fb432d177c956b0c214253a0cbb.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/86/b0869317f407fb01bf7bad7a055b6697/pa/WP80129_8cea6fb432d177c956b0c214253a0cbb.jpg already downloaded
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F86%252Fb0869317f407fb01bf7bad7a055b6697%252Fpa%252FWP80129_92eb54811c47a7929bdb5311fab0614a.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/86/b0869317f407fb01bf7bad7a055b6697/pa/WP80129_92eb54811c47a7929bdb5311fab0614a.jpg already downloaded
2026-03-29 10:37:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e7ae5b31-c19d-5234-9d07-76449a71f39a, identifier: WP80129
2026-03-29 10:37:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e7ae5b31-c19d-5234-9d07-76449a71f39a with identifier: WP80129
2026-03-29 10:37:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e7ae5b31-c19d-5234-9d07-76449a71f39a with identifier: WP80129
2026-03-29 10:37:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e7ae5b31-c19d-5234-9d07-76449a71f39a with identifier: WP80129 to the API
2026-03-29 10:37:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WP80129>
{'auction_title': '',
 'c_o_2_emission_value': 231,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:03:21Z',
 'fuel_type': 'diesel',
 'id': 'e7ae5b31-c19d-5234-9d07-76449a71f39a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP80129',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 105222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgb0/86/b0869317f407fb01bf7bad7a055b6697/pa/WP80129_99d7e783fd7d4729dd1d728b90908ddd.jpg',
                'https://img-pa.auto1.com/imgb0/86/b0869317f407fb01bf7bad7a055b6697/pa/WP80129_7ecf09d7521d21ab01d23087081508b9.jpg',
                'https://img-pa.auto1.com/imgb0/86/b0869317f407fb01bf7bad7a055b6697/pa/WP80129_a9c789a6eab80a2e4e32a8011a31efe5.jpg',
                'https://img-pa.auto1.com/imgb0/86/b0869317f407fb01bf7bad7a055b6697/pa/WP80129_1eece0f4e97c460f92f3067d7b0db738.jpg',
                'https://img-pa.auto1.com/imgb0/86/b0869317f407fb01bf7bad7a055b6697/pa/WP80129_3c4722a07bdc0641eb2ab82f35f1e861.jpg',
                'https://img-pa.auto1.com/imgb0/86/b0869317f407fb01bf7bad7a055b6697/pa/WP80129_48624f380f32a465132cdc2d76fb61b4.jpg',
                'https://img-pa.auto1.com/imgb0/86/b0869317f407fb01bf7bad7a055b6697/pa/WP80129_63538867302838ee025e2281cc2b1429.jpg',
                'https://img-pa.auto1.com/imgb0/86/b0869317f407fb01bf7bad7a055b6697/pa/WP80129_5646579140b79c94e1e2a4318ecfa5ef.jpg',
                'https://img-pa.auto1.com/imgb0/86/b0869317f407fb01bf7bad7a055b6697/pa/WP80129_8cea6fb432d177c956b0c214253a0cbb.jpg',
                'https://img-pa.auto1.com/imgb0/86/b0869317f407fb01bf7bad7a055b6697/pa/WP80129_92eb54811c47a7929bdb5311fab0614a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7ae5b31-c19d-5234-9d07-76449a71f39a/e7ae5b31-c19d-5234-9d07-76449a71f39a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/86/b0869317f407fb01bf7bad7a055b6697/pa/WP80129_99d7e783fd7d4729dd1d728b90908ddd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7ae5b31-c19d-5234-9d07-76449a71f39a/e7ae5b31-c19d-5234-9d07-76449a71f39a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/86/b0869317f407fb01bf7bad7a055b6697/pa/WP80129_7ecf09d7521d21ab01d23087081508b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7ae5b31-c19d-5234-9d07-76449a71f39a/e7ae5b31-c19d-5234-9d07-76449a71f39a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70999,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/86/b0869317f407fb01bf7bad7a055b6697/pa/WP80129_a9c789a6eab80a2e4e32a8011a31efe5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7ae5b31-c19d-5234-9d07-76449a71f39a/e7ae5b31-c19d-5234-9d07-76449a71f39a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/86/b0869317f407fb01bf7bad7a055b6697/pa/WP80129_1eece0f4e97c460f92f3067d7b0db738.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7ae5b31-c19d-5234-9d07-76449a71f39a/e7ae5b31-c19d-5234-9d07-76449a71f39a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56044,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/86/b0869317f407fb01bf7bad7a055b6697/pa/WP80129_3c4722a07bdc0641eb2ab82f35f1e861.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7ae5b31-c19d-5234-9d07-76449a71f39a/e7ae5b31-c19d-5234-9d07-76449a71f39a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/86/b0869317f407fb01bf7bad7a055b6697/pa/WP80129_48624f380f32a465132cdc2d76fb61b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7ae5b31-c19d-5234-9d07-76449a71f39a/e7ae5b31-c19d-5234-9d07-76449a71f39a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/86/b0869317f407fb01bf7bad7a055b6697/pa/WP80129_63538867302838ee025e2281cc2b1429.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7ae5b31-c19d-5234-9d07-76449a71f39a/e7ae5b31-c19d-5234-9d07-76449a71f39a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/86/b0869317f407fb01bf7bad7a055b6697/pa/WP80129_5646579140b79c94e1e2a4318ecfa5ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7ae5b31-c19d-5234-9d07-76449a71f39a/e7ae5b31-c19d-5234-9d07-76449a71f39a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/86/b0869317f407fb01bf7bad7a055b6697/pa/WP80129_8cea6fb432d177c956b0c214253a0cbb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e7ae5b31-c19d-5234-9d07-76449a71f39a/e7ae5b31-c19d-5234-9d07-76449a71f39a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/86/b0869317f407fb01bf7bad7a055b6697/pa/WP80129_92eb54811c47a7929bdb5311fab0614a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-28',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 320 L2 Limited',
 'transmission': 'automatic',
 'trim': '320 L2 Limited',
 'year': 2020}
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP80129%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Saving data for WP80129: {'created_time': 1774780656.141935, 'last_price_update_time': 1774780656.141945, 'auction_closing_time': 1774883001.0}
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP80129') HTTP/1.1" 204 0
2026-03-29 10:37:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AE08285/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:36 [auto1.de] INFO: Channel: 24h | Page: 13 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: HS83117
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: RW76455
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: RP66782
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: RC29911
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: VL48750
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: CZ70893
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ70893%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Scrape type for CZ70893: 0
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: HC32133
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC32133%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Scrape type for HC32133: 0
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: WC25701
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: RS41901
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: CW57830
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: XB95476
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB95476%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Scrape type for XB95476: 0
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: YC02535
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: HK91051
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK91051%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Scrape type for HK91051: 0
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: TW01944
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: RN71628
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN71628%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Scrape type for RN71628: 0
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: HT70874
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: UV60068
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV60068%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Scrape type for UV60068: 0
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: YW93482
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW93482%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Scrape type for YW93482: 0
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: CJ85818
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ85818%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Scrape type for CJ85818: 0
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: CM64848
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM64848%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Scrape type for CM64848: 0
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: KF64937
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: MW29670
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW29670%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Scrape type for MW29670: 0
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: RC86966
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC86966%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Scrape type for RC86966: 0
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: XW48128
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: LT87510
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: WS77403
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: KL19595
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: TY40136
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY40136%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Scrape type for TY40136: 0
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: YV77496
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: NJ52204
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: UP55946
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: BG00548
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG00548%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Scrape type for BG00548: 0
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: SP96872
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP96872%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Scrape type for SP96872: 0
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: FN44778
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN44778%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Scrape type for FN44778: 0
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: YN38539
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: MD51854
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD51854%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Scrape type for MD51854: 0
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: CG08693
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: ZE88330
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE88330%27 HTTP/1.1" 200 None
2026-03-29 10:37:36 [auto1.de] INFO: Scrape type for ZE88330: 0
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: LG10256
2026-03-29 10:37:36 [auto1.de] INFO: Found listing with ID: KK73289
2026-03-29 10:37:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AE08285> (referer: https://www.auto1.com/v1/car-details-view/AE08285/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7c14c3b-8267-5312-b677-a9d9818e347c with identifier: AE08285
2026-03-29 10:37:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7c14c3b-8267-5312-b677-a9d9818e347c with scrape type 1
2026-03-29 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b7c14c3b-8267-5312-b677-a9d9818e347c
2026-03-29 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd3%252F3cd33fc8ef5d395cbc6a5ba01ea9fbde%252Fpa%252FAE08285_ac7ccc3a4ce934fdef51d4ccb980ed81.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d3/3cd33fc8ef5d395cbc6a5ba01ea9fbde/pa/AE08285_ac7ccc3a4ce934fdef51d4ccb980ed81.jpg already downloaded
2026-03-29 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd3%252F3cd33fc8ef5d395cbc6a5ba01ea9fbde%252Fpa%252FAE08285_803f0f0dade863b7d51658611d2955ce.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d3/3cd33fc8ef5d395cbc6a5ba01ea9fbde/pa/AE08285_803f0f0dade863b7d51658611d2955ce.jpg already downloaded
2026-03-29 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd3%252F3cd33fc8ef5d395cbc6a5ba01ea9fbde%252Fpa%252FAE08285_29b737dbaf85772b1cfb103caeed1afa.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d3/3cd33fc8ef5d395cbc6a5ba01ea9fbde/pa/AE08285_29b737dbaf85772b1cfb103caeed1afa.jpg already downloaded
2026-03-29 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd3%252F3cd33fc8ef5d395cbc6a5ba01ea9fbde%252Fpa%252FAE08285_da01e3441a4500a07e6c8ffdd60a2c45.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d3/3cd33fc8ef5d395cbc6a5ba01ea9fbde/pa/AE08285_da01e3441a4500a07e6c8ffdd60a2c45.jpg already downloaded
2026-03-29 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd3%252F3cd33fc8ef5d395cbc6a5ba01ea9fbde%252Fpa%252FAE08285_de77ec9b2686588c81f1593f4c918478.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d3/3cd33fc8ef5d395cbc6a5ba01ea9fbde/pa/AE08285_de77ec9b2686588c81f1593f4c918478.jpg already downloaded
2026-03-29 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd3%252F3cd33fc8ef5d395cbc6a5ba01ea9fbde%252Fpa%252FAE08285_92928ef041d475c531da026ce5d9a6e3.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d3/3cd33fc8ef5d395cbc6a5ba01ea9fbde/pa/AE08285_92928ef041d475c531da026ce5d9a6e3.jpg already downloaded
2026-03-29 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd3%252F3cd33fc8ef5d395cbc6a5ba01ea9fbde%252Fpa%252FAE08285_f97b4ca3bd073aa40981bcdc1cca950e.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d3/3cd33fc8ef5d395cbc6a5ba01ea9fbde/pa/AE08285_f97b4ca3bd073aa40981bcdc1cca950e.jpg already downloaded
2026-03-29 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd3%252F3cd33fc8ef5d395cbc6a5ba01ea9fbde%252Fpa%252FAE08285_cf52b78511b583018308c616e9b884c4.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d3/3cd33fc8ef5d395cbc6a5ba01ea9fbde/pa/AE08285_cf52b78511b583018308c616e9b884c4.jpg already downloaded
2026-03-29 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd3%252F3cd33fc8ef5d395cbc6a5ba01ea9fbde%252Fpa%252FAE08285_70291a61113cef3df47fcccc3e81bff7.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d3/3cd33fc8ef5d395cbc6a5ba01ea9fbde/pa/AE08285_70291a61113cef3df47fcccc3e81bff7.jpg already downloaded
2026-03-29 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fd3%252F3cd33fc8ef5d395cbc6a5ba01ea9fbde%252Fpa%252FAE08285_56e0d9324ccfc97716adc2ed43dd76c5.jpg%27 HTTP/1.1" 200 None
2026-03-29 10:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/d3/3cd33fc8ef5d395cbc6a5ba01ea9fbde/pa/AE08285_56e0d9324ccfc97716adc2ed43dd76c5.jpg already downloaded
2026-03-29 10:37:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7c14c3b-8267-5312-b677-a9d9818e347c, identifier: AE08285
2026-03-29 10:37:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7c14c3b-8267-5312-b677-a9d9818e347c with identifier: AE08285
2026-03-29 10:37:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7c14c3b-8267-5312-b677-a9d9818e347c with identifier: AE08285
2026-03-29 10:37:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7c14c3b-8267-5312-b677-a9d9818e347c with identifier: AE08285 to the API
2026-03-29 10:37:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:37:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AE08285>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 313,
 'expiration_date': '2026-03-30T15:07:07Z',
 'fuel_type': 'diesel',
 'id': 'b7c14c3b-8267-5312-b677-a9d9818e347c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE08285',
 'listing': 'auction',
 'location': 'DE, Zörbig',
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 115717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img3c/d3/3cd33fc8ef5d395cbc6a5ba01ea9fbde/pa/AE08285_ac7ccc3a4ce934fdef51d4ccb980ed81.jpg',
                'https://img-pa.auto1.com/img3c/d3/3cd33fc8ef5d395cbc6a5ba01ea9fbde/pa/AE08285_803f0f0dade863b7d51658611d2955ce.jpg',
                'https://img-pa.auto1.com/img3c/d3/3cd33fc8ef5d395cbc6a5ba01ea9fbde/pa/AE08285_29b737dbaf85772b1cfb103caeed1afa.jpg',
                'https://img-pa.auto1.com/img3c/d3/3cd33fc8ef5d395cbc6a5ba01ea9fbde/pa/AE08285_da01e3441a4500a07e6c8ffdd60a2c45.jpg',
                'https://img-pa.auto1.com/img3c/d3/3cd33fc8ef5d395cbc6a5ba01ea9fbde/pa/AE08285_de77ec9b2686588c81f1593f4c918478.jpg',
                'https://img-pa.auto1.com/img3c/d3/3cd33fc8ef5d395cbc6a5ba01ea9fbde/pa/AE08285_92928ef041d475c531da026ce5d9a6e3.jpg',
                'https://img-pa.auto1.com/img3c/d3/3cd33fc8ef5d395cbc6a5ba01ea9fbde/pa/AE08285_f97b4ca3bd073aa40981bcdc1cca950e.jpg',
                'https://img-pa.auto1.com/img3c/d3/3cd33fc8ef5d395cbc6a5ba01ea9fbde/pa/AE08285_cf52b78511b583018308c616e9b884c4.jpg',
                'https://img-pa.auto1.com/img3c/d3/3cd33fc8ef5d395cbc6a5ba01ea9fbde/pa/AE08285_70291a61113cef3df47fcccc3e81bff7.jpg',
                'https://img-pa.auto1.com/img3c/d3/3cd33fc8ef5d395cbc6a5ba01ea9fbde/pa/AE08285_56e0d9324ccfc97716adc2ed43dd76c5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7c14c3b-8267-5312-b677-a9d9818e347c/b7c14c3b-8267-5312-b677-a9d9818e347c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128777,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/d3/3cd33fc8ef5d395cbc6a5ba01ea9fbde/pa/AE08285_ac7ccc3a4ce934fdef51d4ccb980ed81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7c14c3b-8267-5312-b677-a9d9818e347c/b7c14c3b-8267-5312-b677-a9d9818e347c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/d3/3cd33fc8ef5d395cbc6a5ba01ea9fbde/pa/AE08285_803f0f0dade863b7d51658611d2955ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7c14c3b-8267-5312-b677-a9d9818e347c/b7c14c3b-8267-5312-b677-a9d9818e347c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/d3/3cd33fc8ef5d395cbc6a5ba01ea9fbde/pa/AE08285_29b737dbaf85772b1cfb103caeed1afa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7c14c3b-8267-5312-b677-a9d9818e347c/b7c14c3b-8267-5312-b677-a9d9818e347c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/d3/3cd33fc8ef5d395cbc6a5ba01ea9fbde/pa/AE08285_da01e3441a4500a07e6c8ffdd60a2c45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7c14c3b-8267-5312-b677-a9d9818e347c/b7c14c3b-8267-5312-b677-a9d9818e347c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102371,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/d3/3cd33fc8ef5d395cbc6a5ba01ea9fbde/pa/AE08285_de77ec9b2686588c81f1593f4c918478.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7c14c3b-8267-5312-b677-a9d9818e347c/b7c14c3b-8267-5312-b677-a9d9818e347c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/d3/3cd33fc8ef5d395cbc6a5ba01ea9fbde/pa/AE08285_92928ef041d475c531da026ce5d9a6e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7c14c3b-8267-5312-b677-a9d9818e347c/b7c14c3b-8267-5312-b677-a9d9818e347c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/d3/3cd33fc8ef5d395cbc6a5ba01ea9fbde/pa/AE08285_f97b4ca3bd073aa40981bcdc1cca950e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7c14c3b-8267-5312-b677-a9d9818e347c/b7c14c3b-8267-5312-b677-a9d9818e347c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/d3/3cd33fc8ef5d395cbc6a5ba01ea9fbde/pa/AE08285_cf52b78511b583018308c616e9b884c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7c14c3b-8267-5312-b677-a9d9818e347c/b7c14c3b-8267-5312-b677-a9d9818e347c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101116,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/d3/3cd33fc8ef5d395cbc6a5ba01ea9fbde/pa/AE08285_70291a61113cef3df47fcccc3e81bff7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7c14c3b-8267-5312-b677-a9d9818e347c/b7c14c3b-8267-5312-b677-a9d9818e347c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/d3/3cd33fc8ef5d395cbc6a5ba01ea9fbde/pa/AE08285_56e0d9324ccfc97716adc2ed43dd76c5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi SQ5 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE08285%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Saving data for AE08285: {'created_time': 1774780658.246627, 'last_price_update_time': 1774780658.246637, 'auction_closing_time': 1774883227.0}
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE08285') HTTP/1.1" 204 0
2026-03-29 10:37:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:38 [auto1.de] INFO: Channel: 24h | Page: 14 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: LS49952
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: EN74445
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: XY85959
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY85959%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for XY85959: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: EZ47162
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ47162%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for EZ47162: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: YL95361
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: DZ61875
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: YB72786
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB72786%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for YB72786: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: NC06801
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: TX80950
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX80950%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for TX80950: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: RM28884
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM28884%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for RM28884: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: WJ79239
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ79239%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for WJ79239: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: HA68744
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA68744%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for HA68744: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: FD80734
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD80734%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for FD80734: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: PV13799
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV13799%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for PV13799: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: SF55933
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: NT54414
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT54414%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for NT54414: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: RY86630
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: CU91826
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: RE98096
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE98096%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for RE98096: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: JR00588
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR00588%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for JR00588: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: YY17846
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: RU42318
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU42318%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for RU42318: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: BZ91725
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ91725%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for BZ91725: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: CG73719
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: CK06472
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK06472%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for CK06472: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: NB79280
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: AS80209
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS80209%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for AS80209: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: XK62781
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: AP67523
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP67523%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for AP67523: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: YF68653
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: TF22102
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: SJ86823
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ86823%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for SJ86823: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: FG94497
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: HE99483
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: LF77567
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: JL43427
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL43427%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for JL43427: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: DX27890
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX27890%27 HTTP/1.1" 200 None
2026-03-29 10:37:38 [auto1.de] INFO: Scrape type for DX27890: 0
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: VJ93938
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: AX13429
2026-03-29 10:37:38 [auto1.de] INFO: Found listing with ID: SD17030
2026-03-29 10:37:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:39 [auto1.de] INFO: Channel: 24h | Page: 15 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: JF12446
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: AN60754
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN60754%27 HTTP/1.1" 200 None
2026-03-29 10:37:39 [auto1.de] INFO: Scrape type for AN60754: 0
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: NH81971
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: PU44230
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: ER86835
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: MA20018
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: SU19428
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: UW74525
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: CP06642
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: EH70293
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH70293%27 HTTP/1.1" 200 None
2026-03-29 10:37:39 [auto1.de] INFO: Scrape type for EH70293: 0
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: YX40073
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: NR97756
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR97756%27 HTTP/1.1" 200 None
2026-03-29 10:37:39 [auto1.de] INFO: Scrape type for NR97756: 0
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: LC05735
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: AW14620
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: FM78793
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: VH46900
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: ZN75041
2026-03-29 10:37:39 [auto1.de] INFO: Found listing with ID: JX06129
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX06129%27 HTTP/1.1" 200 None
2026-03-29 10:37:40 [auto1.de] INFO: Scrape type for JX06129: 0
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: XV57552
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV57552%27 HTTP/1.1" 200 None
2026-03-29 10:37:40 [auto1.de] INFO: Scrape type for XV57552: 0
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: UW93361
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: YY00897
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: DE21080
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: ZP65093
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: JN49232
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: WV35399
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV35399%27 HTTP/1.1" 200 None
2026-03-29 10:37:40 [auto1.de] INFO: Scrape type for WV35399: 0
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: DF56561
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF56561%27 HTTP/1.1" 200 None
2026-03-29 10:37:40 [auto1.de] INFO: Scrape type for DF56561: 0
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: WX35600
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX35600%27 HTTP/1.1" 200 None
2026-03-29 10:37:40 [auto1.de] INFO: Scrape type for WX35600: 0
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: MH82983
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH82983%27 HTTP/1.1" 200 None
2026-03-29 10:37:40 [auto1.de] INFO: Scrape type for MH82983: 0
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: ZT07846
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: WG75781
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: MM39918
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM39918%27 HTTP/1.1" 200 None
2026-03-29 10:37:40 [auto1.de] INFO: Scrape type for MM39918: 0
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: ZR25455
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: YJ88627
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ88627%27 HTTP/1.1" 200 None
2026-03-29 10:37:40 [auto1.de] INFO: Scrape type for YJ88627: 0
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: AF95202
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF95202%27 HTTP/1.1" 200 None
2026-03-29 10:37:40 [auto1.de] INFO: Scrape type for AF95202: 0
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: LT54057
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: VY54552
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: XV17111
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV17111%27 HTTP/1.1" 200 None
2026-03-29 10:37:40 [auto1.de] INFO: Scrape type for XV17111: 0
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: DV01319
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV01319%27 HTTP/1.1" 200 None
2026-03-29 10:37:40 [auto1.de] INFO: Scrape type for DV01319: 0
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: EW76820
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW76820%27 HTTP/1.1" 200 None
2026-03-29 10:37:40 [auto1.de] INFO: Scrape type for EW76820: 0
2026-03-29 10:37:40 [auto1.de] INFO: Found listing with ID: JK52723
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK52723%27 HTTP/1.1" 200 None
2026-03-29 10:37:40 [auto1.de] INFO: Scrape type for JK52723: 0
2026-03-29 10:37:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:41 [auto1.de] INFO: Channel: 24h | Page: 16 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: GJ78269
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: HW71141
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: GR38931
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR38931%27 HTTP/1.1" 200 None
2026-03-29 10:37:41 [auto1.de] INFO: Scrape type for GR38931: 0
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: FS91363
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS91363%27 HTTP/1.1" 200 None
2026-03-29 10:37:41 [auto1.de] INFO: Scrape type for FS91363: 0
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: AZ86702
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ86702%27 HTTP/1.1" 200 None
2026-03-29 10:37:41 [auto1.de] INFO: Scrape type for AZ86702: 0
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: EM69554
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: ZR39968
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR39968%27 HTTP/1.1" 200 None
2026-03-29 10:37:41 [auto1.de] INFO: Scrape type for ZR39968: 0
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: EU39655
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: TX59054
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: RV72867
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: XT69734
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: PL85371
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL85371%27 HTTP/1.1" 200 None
2026-03-29 10:37:41 [auto1.de] INFO: Scrape type for PL85371: 0
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: XF01324
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: UP89204
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: TZ11746
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: SL35659
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL35659%27 HTTP/1.1" 200 None
2026-03-29 10:37:41 [auto1.de] INFO: Scrape type for SL35659: 0
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: GJ17165
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ17165%27 HTTP/1.1" 200 None
2026-03-29 10:37:41 [auto1.de] INFO: Scrape type for GJ17165: 0
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: ZK08136
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: VF37611
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF37611%27 HTTP/1.1" 200 None
2026-03-29 10:37:41 [auto1.de] INFO: Scrape type for VF37611: 0
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: ZU15284
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU15284%27 HTTP/1.1" 200 None
2026-03-29 10:37:41 [auto1.de] INFO: Scrape type for ZU15284: 0
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: VS05622
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: CU27746
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: UN73859
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: VG22194
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: VH01397
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH01397%27 HTTP/1.1" 200 None
2026-03-29 10:37:41 [auto1.de] INFO: Scrape type for VH01397: 0
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: UR30493
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR30493%27 HTTP/1.1" 200 None
2026-03-29 10:37:41 [auto1.de] INFO: Scrape type for UR30493: 0
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: FD54213
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD54213%27 HTTP/1.1" 200 None
2026-03-29 10:37:41 [auto1.de] INFO: Scrape type for FD54213: 0
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: JY95314
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY95314%27 HTTP/1.1" 200 None
2026-03-29 10:37:41 [auto1.de] INFO: Scrape type for JY95314: 0
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: JT90882
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: ZR98160
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR98160%27 HTTP/1.1" 200 None
2026-03-29 10:37:41 [auto1.de] INFO: Scrape type for ZR98160: 0
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: AM33807
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM33807%27 HTTP/1.1" 200 None
2026-03-29 10:37:41 [auto1.de] INFO: Scrape type for AM33807: 0
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: AJ18698
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: MG97845
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG97845%27 HTTP/1.1" 200 None
2026-03-29 10:37:41 [auto1.de] INFO: Scrape type for MG97845: 0
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: UM62946
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM62946%27 HTTP/1.1" 200 None
2026-03-29 10:37:41 [auto1.de] INFO: Scrape type for UM62946: 0
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: EN76399
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN76399%27 HTTP/1.1" 200 None
2026-03-29 10:37:41 [auto1.de] INFO: Scrape type for EN76399: 0
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: CL40632
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL40632%27 HTTP/1.1" 200 None
2026-03-29 10:37:41 [auto1.de] INFO: Scrape type for CL40632: 0
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: AG68218
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: YZ27957
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: GA63896
2026-03-29 10:37:41 [auto1.de] INFO: Found listing with ID: YP19468
2026-03-29 10:37:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:42 [auto1.de] INFO: Channel: 24h | Page: 17 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: TW27373
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW27373%27 HTTP/1.1" 200 None
2026-03-29 10:37:42 [auto1.de] INFO: Scrape type for TW27373: 0
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: PR12496
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR12496%27 HTTP/1.1" 200 None
2026-03-29 10:37:42 [auto1.de] INFO: Scrape type for PR12496: 0
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: PY00065
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY00065%27 HTTP/1.1" 200 None
2026-03-29 10:37:42 [auto1.de] INFO: Scrape type for PY00065: 0
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: NZ51315
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: HZ75916
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ75916%27 HTTP/1.1" 200 None
2026-03-29 10:37:42 [auto1.de] INFO: Scrape type for HZ75916: 0
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: VH44928
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: WC28645
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: DD41075
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD41075%27 HTTP/1.1" 200 None
2026-03-29 10:37:42 [auto1.de] INFO: Scrape type for DD41075: 0
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: LN11604
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: VL75204
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL75204%27 HTTP/1.1" 200 None
2026-03-29 10:37:42 [auto1.de] INFO: Scrape type for VL75204: 0
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: XR19518
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: JY40414
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY40414%27 HTTP/1.1" 200 None
2026-03-29 10:37:42 [auto1.de] INFO: Scrape type for JY40414: 0
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: KG80613
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG80613%27 HTTP/1.1" 200 None
2026-03-29 10:37:42 [auto1.de] INFO: Scrape type for KG80613: 0
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: RB81159
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB81159%27 HTTP/1.1" 200 None
2026-03-29 10:37:42 [auto1.de] INFO: Scrape type for RB81159: 0
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: FE98948
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: GT84792
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: GS84935
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: KM43405
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM43405%27 HTTP/1.1" 200 None
2026-03-29 10:37:42 [auto1.de] INFO: Scrape type for KM43405: 0
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: UK22592
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: FU28651
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: JM01437
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM01437%27 HTTP/1.1" 200 None
2026-03-29 10:37:42 [auto1.de] INFO: Scrape type for JM01437: 0
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: GY36946
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: PV67596
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: ET29931
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: YF03838
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF03838%27 HTTP/1.1" 200 None
2026-03-29 10:37:42 [auto1.de] INFO: Scrape type for YF03838: 0
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: CL60178
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL60178%27 HTTP/1.1" 200 None
2026-03-29 10:37:42 [auto1.de] INFO: Scrape type for CL60178: 0
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: BP04527
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: AH10770
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH10770%27 HTTP/1.1" 200 None
2026-03-29 10:37:42 [auto1.de] INFO: Scrape type for AH10770: 0
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: PW13353
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: GE40777
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE40777%27 HTTP/1.1" 200 None
2026-03-29 10:37:42 [auto1.de] INFO: Scrape type for GE40777: 0
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: JG07802
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: TA43023
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA43023%27 HTTP/1.1" 200 None
2026-03-29 10:37:42 [auto1.de] INFO: Scrape type for TA43023: 0
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: RC29433
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: LP47085
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP47085%27 HTTP/1.1" 200 None
2026-03-29 10:37:42 [auto1.de] INFO: Scrape type for LP47085: 0
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: VD46825
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD46825%27 HTTP/1.1" 200 None
2026-03-29 10:37:42 [auto1.de] INFO: Scrape type for VD46825: 0
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: YE68062
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: MP83511
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP83511%27 HTTP/1.1" 200 None
2026-03-29 10:37:42 [auto1.de] INFO: Scrape type for MP83511: 0
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: FV18032
2026-03-29 10:37:42 [auto1.de] INFO: Found listing with ID: AK95286
2026-03-29 10:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK95286%27 HTTP/1.1" 200 None
2026-03-29 10:37:43 [auto1.de] INFO: Scrape type for AK95286: 0
2026-03-29 10:37:43 [auto1.de] INFO: Found listing with ID: JG50197
2026-03-29 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG50197%27 HTTP/1.1" 200 None
2026-03-29 10:37:43 [auto1.de] INFO: Scrape type for JG50197: 0
2026-03-29 10:37:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:44 [auto1.de] INFO: Channel: 24h | Page: 18 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: XH92207
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH92207%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for XH92207: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: JA02220
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: AX71998
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX71998%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for AX71998: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: JN21638
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: MN72943
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN72943%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for MN72943: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: PH87632
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH87632%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for PH87632: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: MA84823
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: NT47334
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT47334%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for NT47334: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: DK51297
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK51297%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for DK51297: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: AV07522
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV07522%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for AV07522: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: MN30127
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: ZA25327
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA25327%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for ZA25327: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: YE47766
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE47766%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for YE47766: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: AY52280
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: ST92465
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST92465%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for ST92465: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: EY37424
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: MT94431
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: ZF33601
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF33601%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for ZF33601: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: BP69387
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP69387%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for BP69387: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: PF83814
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF83814%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for PF83814: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: PS96844
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: DH90644
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: UX35771
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX35771%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for UX35771: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: LC73868
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC73868%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for LC73868: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: JX17903
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: YE89715
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE89715%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for YE89715: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: NX25429
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: FB30616
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: PZ87651
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ87651%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for PZ87651: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: WR49956
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR49956%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for WR49956: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: EU48519
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU48519%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for EU48519: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: EM09444
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: HS59554
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS59554%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for HS59554: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: VU90894
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU90894%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for VU90894: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: AL66084
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL66084%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for AL66084: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: WF31027
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF31027%27 HTTP/1.1" 200 None
2026-03-29 10:37:44 [auto1.de] INFO: Scrape type for WF31027: 0
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: KJ73179
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: VM07579
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: XH18940
2026-03-29 10:37:44 [auto1.de] INFO: Found listing with ID: UZ89172
2026-03-29 10:37:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:45 [auto1.de] INFO: Channel: 24h | Page: 19 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: EF06925
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: KR46332
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR46332%27 HTTP/1.1" 200 None
2026-03-29 10:37:45 [auto1.de] INFO: Scrape type for KR46332: 0
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: UE56505
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: YS85982
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS85982%27 HTTP/1.1" 200 None
2026-03-29 10:37:45 [auto1.de] INFO: Scrape type for YS85982: 0
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: KC50337
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC50337%27 HTTP/1.1" 200 None
2026-03-29 10:37:45 [auto1.de] INFO: Scrape type for KC50337: 0
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: TR93945
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: EP14807
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP14807%27 HTTP/1.1" 200 None
2026-03-29 10:37:45 [auto1.de] INFO: Scrape type for EP14807: 0
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: XG49869
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG49869%27 HTTP/1.1" 200 None
2026-03-29 10:37:45 [auto1.de] INFO: Scrape type for XG49869: 0
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: ZW53829
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW53829%27 HTTP/1.1" 200 None
2026-03-29 10:37:45 [auto1.de] INFO: Scrape type for ZW53829: 0
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: UF10359
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: CE58616
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE58616%27 HTTP/1.1" 200 None
2026-03-29 10:37:45 [auto1.de] INFO: Scrape type for CE58616: 0
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: KS98119
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS98119%27 HTTP/1.1" 200 None
2026-03-29 10:37:45 [auto1.de] INFO: Scrape type for KS98119: 0
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: HW05295
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW05295%27 HTTP/1.1" 200 None
2026-03-29 10:37:45 [auto1.de] INFO: Scrape type for HW05295: 0
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: BN60503
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: BG41279
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: DK12229
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK12229%27 HTTP/1.1" 200 None
2026-03-29 10:37:45 [auto1.de] INFO: Scrape type for DK12229: 0
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: ND89828
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: YB47390
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB47390%27 HTTP/1.1" 200 None
2026-03-29 10:37:45 [auto1.de] INFO: Scrape type for YB47390: 0
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: VX00455
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX00455%27 HTTP/1.1" 200 None
2026-03-29 10:37:45 [auto1.de] INFO: Scrape type for VX00455: 0
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: VW07399
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW07399%27 HTTP/1.1" 200 None
2026-03-29 10:37:45 [auto1.de] INFO: Scrape type for VW07399: 0
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: SZ67140
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ67140%27 HTTP/1.1" 200 None
2026-03-29 10:37:45 [auto1.de] INFO: Scrape type for SZ67140: 0
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: CK62820
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: HT40242
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT40242%27 HTTP/1.1" 200 None
2026-03-29 10:37:45 [auto1.de] INFO: Scrape type for HT40242: 0
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: FC82221
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: MF60875
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: KT60854
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: AC96507
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC96507%27 HTTP/1.1" 200 None
2026-03-29 10:37:45 [auto1.de] INFO: Scrape type for AC96507: 0
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: YS65782
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS65782%27 HTTP/1.1" 200 None
2026-03-29 10:37:45 [auto1.de] INFO: Scrape type for YS65782: 0
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: MG42603
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: FK12887
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: ZU40023
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU40023%27 HTTP/1.1" 200 None
2026-03-29 10:37:45 [auto1.de] INFO: Scrape type for ZU40023: 0
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: CH93645
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: PE55813
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE55813%27 HTTP/1.1" 200 None
2026-03-29 10:37:45 [auto1.de] INFO: Scrape type for PE55813: 0
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: JP33538
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: YT05280
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: RF07068
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: MU49508
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: KD86114
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: AY96814
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY96814%27 HTTP/1.1" 200 None
2026-03-29 10:37:45 [auto1.de] INFO: Scrape type for AY96814: 0
2026-03-29 10:37:45 [auto1.de] INFO: Found listing with ID: EF75873
2026-03-29 10:37:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:46 [auto1.de] INFO: Channel: 24h | Page: 20 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: HZ55109
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: UR98067
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: PT29857
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT29857%27 HTTP/1.1" 200 None
2026-03-29 10:37:46 [auto1.de] INFO: Scrape type for PT29857: 0
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: CX74060
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: LA18154
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: WA25791
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA25791%27 HTTP/1.1" 200 None
2026-03-29 10:37:46 [auto1.de] INFO: Scrape type for WA25791: 0
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: LN99770
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN99770%27 HTTP/1.1" 200 None
2026-03-29 10:37:46 [auto1.de] INFO: Scrape type for LN99770: 0
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: NK17990
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK17990%27 HTTP/1.1" 200 None
2026-03-29 10:37:46 [auto1.de] INFO: Scrape type for NK17990: 0
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: CY43451
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY43451%27 HTTP/1.1" 200 None
2026-03-29 10:37:46 [auto1.de] INFO: Scrape type for CY43451: 0
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: ZX96561
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX96561%27 HTTP/1.1" 200 None
2026-03-29 10:37:46 [auto1.de] INFO: Scrape type for ZX96561: 0
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: LX79709
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX79709%27 HTTP/1.1" 200 None
2026-03-29 10:37:46 [auto1.de] INFO: Scrape type for LX79709: 0
2026-03-29 10:37:46 [auto1.de] INFO: Found listing with ID: KC50640
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC50640%27 HTTP/1.1" 200 None
2026-03-29 10:37:47 [auto1.de] INFO: Scrape type for KC50640: 0
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: VR60747
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR60747%27 HTTP/1.1" 200 None
2026-03-29 10:37:47 [auto1.de] INFO: Scrape type for VR60747: 0
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: SZ06147
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ06147%27 HTTP/1.1" 200 None
2026-03-29 10:37:47 [auto1.de] INFO: Scrape type for SZ06147: 0
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: CW95568
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: NV70278
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV70278%27 HTTP/1.1" 200 None
2026-03-29 10:37:47 [auto1.de] INFO: Scrape type for NV70278: 0
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: ZL59344
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL59344%27 HTTP/1.1" 200 None
2026-03-29 10:37:47 [auto1.de] INFO: Scrape type for ZL59344: 0
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: GD26044
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: EE96817
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: NH06338
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: DS59005
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS59005%27 HTTP/1.1" 200 None
2026-03-29 10:37:47 [auto1.de] INFO: Scrape type for DS59005: 0
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: MF86039
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: JV48558
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV48558%27 HTTP/1.1" 200 None
2026-03-29 10:37:47 [auto1.de] INFO: Scrape type for JV48558: 0
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: SJ64604
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: LH54346
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH54346%27 HTTP/1.1" 200 None
2026-03-29 10:37:47 [auto1.de] INFO: Scrape type for LH54346: 0
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: DT57257
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: VT63649
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: JX79740
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: FR69109
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: BS19118
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: JX21647
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX21647%27 HTTP/1.1" 200 None
2026-03-29 10:37:47 [auto1.de] INFO: Scrape type for JX21647: 0
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: VU30885
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU30885%27 HTTP/1.1" 200 None
2026-03-29 10:37:47 [auto1.de] INFO: Scrape type for VU30885: 0
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: MM90627
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM90627%27 HTTP/1.1" 200 None
2026-03-29 10:37:47 [auto1.de] INFO: Scrape type for MM90627: 0
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: UP11609
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: SL92984
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: GH39731
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: JG03809
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG03809%27 HTTP/1.1" 200 None
2026-03-29 10:37:47 [auto1.de] INFO: Scrape type for JG03809: 0
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: SN42334
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: NV30450
2026-03-29 10:37:47 [auto1.de] INFO: Found listing with ID: ZW50012
2026-03-29 10:37:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:48 [auto1.de] INFO: Channel: 24h | Page: 21 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: YV85598
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV85598%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for YV85598: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: LE50284
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE50284%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for LE50284: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: AB49133
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: FN52751
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN52751%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for FN52751: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: KB67170
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: SC23766
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC23766%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for SC23766: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: CL73395
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL73395%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for CL73395: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: ZU96971
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU96971%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for ZU96971: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: KF93262
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: BP80209
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: FR18143
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: FP56300
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP56300%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for FP56300: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: WF13702
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: DU56840
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU56840%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for DU56840: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: HJ42862
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ42862%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for HJ42862: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: HH06006
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: LU46217
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: NC63257
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC63257%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for NC63257: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: HA49497
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA49497%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for HA49497: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: GN25688
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN25688%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for GN25688: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: DC32299
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: SD24294
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD24294%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for SD24294: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: JY97697
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY97697%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for JY97697: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: ZM10504
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: NA60022
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: CH24864
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: GX79735
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX79735%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for GX79735: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: ZY33636
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY33636%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for ZY33636: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: HJ92241
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ92241%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for HJ92241: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: FL18278
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL18278%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for FL18278: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: TE81012
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE81012%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for TE81012: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: CG37224
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG37224%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for CG37224: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: BE55111
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE55111%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for BE55111: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: LV65947
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV65947%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for LV65947: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: VN71215
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN71215%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for VN71215: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: FY57331
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY57331%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for FY57331: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: GS42870
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS42870%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for GS42870: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: MT54263
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT54263%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for MT54263: 0
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: AK26500
2026-03-29 10:37:48 [auto1.de] INFO: Found listing with ID: ZZ49081
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ49081%27 HTTP/1.1" 200 None
2026-03-29 10:37:48 [auto1.de] INFO: Scrape type for ZZ49081: 0
2026-03-29 10:37:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:37:57 [auto1.de] INFO: Channel: 24h | Page: 22 | totalHits: 6726 | hits on page: 40
2026-03-29 10:37:57 [auto1.de] INFO: Found listing with ID: JL32962
2026-03-29 10:37:57 [auto1.de] INFO: Found listing with ID: GY35476
2026-03-29 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY35476%27 HTTP/1.1" 200 None
2026-03-29 10:37:57 [auto1.de] INFO: Scrape type for GY35476: 0
2026-03-29 10:37:57 [auto1.de] INFO: Found listing with ID: UN88738
2026-03-29 10:37:57 [auto1.de] INFO: Found listing with ID: TV18525
2026-03-29 10:37:57 [auto1.de] INFO: Found listing with ID: GB49809
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB49809%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for GB49809: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: LT85175
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT85175%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for LT85175: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: MU81714
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: ZL07582
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: PW12377
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: RD52099
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: LX33649
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX33649%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for LX33649: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: CX30934
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: KT37105
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: NT69326
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT69326%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for NT69326: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: MP45750
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP45750%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for MP45750: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: BS14329
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS14329%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for BS14329: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: HW62804
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW62804%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for HW62804: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: BS91998
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS91998%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for BS91998: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: WW27591
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW27591%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for WW27591: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: SS07399
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: ZM46839
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM46839%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for ZM46839: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: PL16151
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL16151%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for PL16151: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: GT44390
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT44390%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for GT44390: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: NK02034
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK02034%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for NK02034: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: RR54011
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: PN39432
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN39432%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for PN39432: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: XB31619
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB31619%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for XB31619: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: JL12737
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: YA55481
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA55481%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for YA55481: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: KP96972
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: YW59624
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: VV46079
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: DJ56711
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ56711%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for DJ56711: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: AM69365
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: EP30050
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP30050%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for EP30050: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: GX41654
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX41654%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for GX41654: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: NX68514
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: LW18163
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW18163%27 HTTP/1.1" 200 None
2026-03-29 10:37:58 [auto1.de] INFO: Scrape type for LW18163: 0
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: DW75956
2026-03-29 10:37:58 [auto1.de] INFO: Found listing with ID: DS69815
2026-03-29 10:37:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:00 [auto1.de] INFO: Channel: 24h | Page: 23 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: AR05539
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: TG96584
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG96584%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for TG96584: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: RC23376
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC23376%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for RC23376: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: GS08469
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: FR19321
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: XB74234
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: TF63689
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: BD16858
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: VG72840
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: BM86036
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM86036%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for BM86036: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: YD12579
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: KH12936
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: BP45840
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP45840%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for BP45840: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: NU91903
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: KG33917
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: FL79995
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL79995%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for FL79995: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: BE44691
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: FA63852
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA63852%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for FA63852: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: ZK29983
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: AR18568
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: PM92730
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM92730%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for PM92730: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: FC63717
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: RD35466
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD35466%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for RD35466: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: YF63409
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: SK60410
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK60410%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for SK60410: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: TS01373
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS01373%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for TS01373: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: ST88871
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST88871%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for ST88871: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: KH96137
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH96137%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for KH96137: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: FH64312
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH64312%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for FH64312: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: BE37865
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE37865%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for BE37865: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: VX41895
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX41895%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for VX41895: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: GV12841
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV12841%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for GV12841: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: HN51683
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN51683%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for HN51683: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: JJ82398
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: KT58980
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: FP71706
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP71706%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for FP71706: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: JF69032
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: UP80660
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: ML63417
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML63417%27 HTTP/1.1" 200 None
2026-03-29 10:38:00 [auto1.de] INFO: Scrape type for ML63417: 0
2026-03-29 10:38:00 [auto1.de] INFO: Found listing with ID: VV17039
2026-03-29 10:38:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:02 [auto1.de] INFO: Channel: 24h | Page: 24 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: RU02977
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU02977%27 HTTP/1.1" 200 None
2026-03-29 10:38:02 [auto1.de] INFO: Scrape type for RU02977: 0
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: TU49821
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: AZ23740
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ23740%27 HTTP/1.1" 200 None
2026-03-29 10:38:02 [auto1.de] INFO: Scrape type for AZ23740: 0
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: RW26653
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW26653%27 HTTP/1.1" 200 None
2026-03-29 10:38:02 [auto1.de] INFO: Scrape type for RW26653: 0
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: MN42254
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN42254%27 HTTP/1.1" 200 None
2026-03-29 10:38:02 [auto1.de] INFO: Scrape type for MN42254: 0
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: GF81751
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF81751%27 HTTP/1.1" 200 None
2026-03-29 10:38:02 [auto1.de] INFO: Scrape type for GF81751: 0
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: BK94674
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: ZY72717
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY72717%27 HTTP/1.1" 200 None
2026-03-29 10:38:02 [auto1.de] INFO: Scrape type for ZY72717: 0
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: GS01911
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS01911%27 HTTP/1.1" 200 None
2026-03-29 10:38:02 [auto1.de] INFO: Scrape type for GS01911: 0
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: JL44277
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: JE51939
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: AS86297
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: UV04147
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV04147%27 HTTP/1.1" 200 None
2026-03-29 10:38:02 [auto1.de] INFO: Scrape type for UV04147: 0
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: CR11100
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: WN56158
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: JN93492
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN93492%27 HTTP/1.1" 200 None
2026-03-29 10:38:02 [auto1.de] INFO: Scrape type for JN93492: 0
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: KC39120
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: LM88961
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: AJ08614
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ08614%27 HTTP/1.1" 200 None
2026-03-29 10:38:02 [auto1.de] INFO: Scrape type for AJ08614: 0
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: AN54197
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: RB81391
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: DJ54071
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: HM10464
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: HW22525
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: KH31418
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH31418%27 HTTP/1.1" 200 None
2026-03-29 10:38:02 [auto1.de] INFO: Scrape type for KH31418: 0
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: DB44844
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: UY73943
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: TN59671
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: JB75617
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: GC63268
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: XS27718
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS27718%27 HTTP/1.1" 200 None
2026-03-29 10:38:02 [auto1.de] INFO: Scrape type for XS27718: 0
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: KJ86247
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ86247%27 HTTP/1.1" 200 None
2026-03-29 10:38:02 [auto1.de] INFO: Scrape type for KJ86247: 0
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: AF22062
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF22062%27 HTTP/1.1" 200 None
2026-03-29 10:38:02 [auto1.de] INFO: Scrape type for AF22062: 0
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: VB40940
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: FH59067
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH59067%27 HTTP/1.1" 200 None
2026-03-29 10:38:02 [auto1.de] INFO: Scrape type for FH59067: 0
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: YJ30839
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ30839%27 HTTP/1.1" 200 None
2026-03-29 10:38:02 [auto1.de] INFO: Scrape type for YJ30839: 0
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: PC09054
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: YS06113
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: BD68188
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD68188%27 HTTP/1.1" 200 None
2026-03-29 10:38:02 [auto1.de] INFO: Scrape type for BD68188: 0
2026-03-29 10:38:02 [auto1.de] INFO: Found listing with ID: VX34650
2026-03-29 10:38:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:03 [auto1.de] INFO: Channel: 24h | Page: 25 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:03 [auto1.de] INFO: Found listing with ID: FA27220
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA27220%27 HTTP/1.1" 200 None
2026-03-29 10:38:03 [auto1.de] INFO: Scrape type for FA27220: 0
2026-03-29 10:38:03 [auto1.de] INFO: Found listing with ID: ZK39912
2026-03-29 10:38:03 [auto1.de] INFO: Found listing with ID: MU83359
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU83359%27 HTTP/1.1" 200 None
2026-03-29 10:38:03 [auto1.de] INFO: Scrape type for MU83359: 0
2026-03-29 10:38:03 [auto1.de] INFO: Found listing with ID: VU87810
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU87810%27 HTTP/1.1" 200 None
2026-03-29 10:38:03 [auto1.de] INFO: Scrape type for VU87810: 0
2026-03-29 10:38:03 [auto1.de] INFO: Found listing with ID: UN58886
2026-03-29 10:38:03 [auto1.de] INFO: Found listing with ID: YS81106
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS81106%27 HTTP/1.1" 200 None
2026-03-29 10:38:03 [auto1.de] INFO: Scrape type for YS81106: 0
2026-03-29 10:38:03 [auto1.de] INFO: Found listing with ID: FZ50846
2026-03-29 10:38:03 [auto1.de] INFO: Found listing with ID: JN76212
2026-03-29 10:38:03 [auto1.de] INFO: Found listing with ID: HN35762
2026-03-29 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN35762%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for HN35762: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: TD63054
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD63054%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for TD63054: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: TF08287
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: BA55761
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA55761%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for BA55761: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: TU29288
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: WS51511
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS51511%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for WS51511: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: WP48993
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP48993%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for WP48993: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: NR54362
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR54362%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for NR54362: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: PU72162
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU72162%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for PU72162: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: LS95970
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS95970%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for LS95970: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: GJ26621
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ26621%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for GJ26621: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: BU40538
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU40538%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for BU40538: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: KT21278
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT21278%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for KT21278: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: AG77275
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: MG37810
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: BY58400
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: LM03290
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: ZZ75608
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ75608%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for ZZ75608: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: WT11127
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT11127%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for WT11127: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: NB76223
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB76223%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for NB76223: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: DJ32425
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: BZ42521
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ42521%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for BZ42521: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: DV41377
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: PC86421
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC86421%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for PC86421: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: NY81856
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY81856%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for NY81856: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: UV10868
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV10868%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for UV10868: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: SY55546
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY55546%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for SY55546: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: PA10723
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA10723%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for PA10723: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: BP32495
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: ZM52655
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: ZZ74816
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ74816%27 HTTP/1.1" 200 None
2026-03-29 10:38:04 [auto1.de] INFO: Scrape type for ZZ74816: 0
2026-03-29 10:38:04 [auto1.de] INFO: Found listing with ID: BB33034
2026-03-29 10:38:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:06 [scrapy.extensions.logstats] INFO: Crawled 88 pages (at 27 pages/min), scraped 224 items (at 45 items/min)
2026-03-29 10:38:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 160MiB
2026-03-29 10:38:06 [auto1.de] INFO: Channel: 24h | Page: 26 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: JH84206
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: HT55268
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: DG23161
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: RP43844
2026-03-29 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP43844%27 HTTP/1.1" 200 None
2026-03-29 10:38:06 [auto1.de] INFO: Scrape type for RP43844: 0
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: GP28928
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: YD55328
2026-03-29 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD55328%27 HTTP/1.1" 200 None
2026-03-29 10:38:06 [auto1.de] INFO: Scrape type for YD55328: 0
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: UT27249
2026-03-29 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT27249%27 HTTP/1.1" 200 None
2026-03-29 10:38:06 [auto1.de] INFO: Scrape type for UT27249: 0
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: AF35013
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: JV22464
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: WG27498
2026-03-29 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG27498%27 HTTP/1.1" 200 None
2026-03-29 10:38:06 [auto1.de] INFO: Scrape type for WG27498: 0
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: RB85475
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: GY48177
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: XM82116
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: SZ74678
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: SV18867
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: SL47086
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: EJ65167
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: JT14864
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: JR97371
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: VS79881
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: LS56228
2026-03-29 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS56228%27 HTTP/1.1" 200 None
2026-03-29 10:38:06 [auto1.de] INFO: Scrape type for LS56228: 0
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: ZZ71304
2026-03-29 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ71304%27 HTTP/1.1" 200 None
2026-03-29 10:38:06 [auto1.de] INFO: Scrape type for ZZ71304: 0
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: LN76006
2026-03-29 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN76006%27 HTTP/1.1" 200 None
2026-03-29 10:38:06 [auto1.de] INFO: Scrape type for LN76006: 0
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: CU86908
2026-03-29 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU86908%27 HTTP/1.1" 200 None
2026-03-29 10:38:06 [auto1.de] INFO: Scrape type for CU86908: 0
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: JC14398
2026-03-29 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC14398%27 HTTP/1.1" 200 None
2026-03-29 10:38:06 [auto1.de] INFO: Scrape type for JC14398: 0
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: HC88789
2026-03-29 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC88789%27 HTTP/1.1" 200 None
2026-03-29 10:38:06 [auto1.de] INFO: Scrape type for HC88789: 0
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: JM14062
2026-03-29 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM14062%27 HTTP/1.1" 200 None
2026-03-29 10:38:06 [auto1.de] INFO: Scrape type for JM14062: 0
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: PH65688
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: JM99769
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: MF41784
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: XR81453
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: SC06812
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: SA96746
2026-03-29 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA96746%27 HTTP/1.1" 200 None
2026-03-29 10:38:06 [auto1.de] INFO: Scrape type for SA96746: 0
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: HJ79355
2026-03-29 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ79355%27 HTTP/1.1" 200 None
2026-03-29 10:38:06 [auto1.de] INFO: Scrape type for HJ79355: 0
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: ZE36621
2026-03-29 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE36621%27 HTTP/1.1" 200 None
2026-03-29 10:38:06 [auto1.de] INFO: Scrape type for ZE36621: 0
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: RY72669
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: HB27474
2026-03-29 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB27474%27 HTTP/1.1" 200 None
2026-03-29 10:38:06 [auto1.de] INFO: Scrape type for HB27474: 0
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: MY28321
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: FK00341
2026-03-29 10:38:06 [auto1.de] INFO: Found listing with ID: XZ46710
2026-03-29 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ46710%27 HTTP/1.1" 200 None
2026-03-29 10:38:06 [auto1.de] INFO: Scrape type for XZ46710: 0
2026-03-29 10:38:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:07 [auto1.de] INFO: Channel: 24h | Page: 27 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:07 [auto1.de] INFO: Found listing with ID: BZ86499
2026-03-29 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ86499%27 HTTP/1.1" 200 None
2026-03-29 10:38:07 [auto1.de] INFO: Scrape type for BZ86499: 0
2026-03-29 10:38:07 [auto1.de] INFO: Found listing with ID: LE46493
2026-03-29 10:38:07 [auto1.de] INFO: Found listing with ID: EG31023
2026-03-29 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG31023%27 HTTP/1.1" 200 None
2026-03-29 10:38:07 [auto1.de] INFO: Scrape type for EG31023: 0
2026-03-29 10:38:07 [auto1.de] INFO: Found listing with ID: NZ72675
2026-03-29 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ72675%27 HTTP/1.1" 200 None
2026-03-29 10:38:07 [auto1.de] INFO: Scrape type for NZ72675: 0
2026-03-29 10:38:07 [auto1.de] INFO: Found listing with ID: EY45109
2026-03-29 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY45109%27 HTTP/1.1" 200 None
2026-03-29 10:38:07 [auto1.de] INFO: Scrape type for EY45109: 0
2026-03-29 10:38:07 [auto1.de] INFO: Found listing with ID: XR69964
2026-03-29 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR69964%27 HTTP/1.1" 200 None
2026-03-29 10:38:07 [auto1.de] INFO: Scrape type for XR69964: 0
2026-03-29 10:38:07 [auto1.de] INFO: Found listing with ID: MX26895
2026-03-29 10:38:07 [auto1.de] INFO: Found listing with ID: CS81826
2026-03-29 10:38:07 [auto1.de] INFO: Found listing with ID: LT72401
2026-03-29 10:38:07 [auto1.de] INFO: Found listing with ID: LJ65077
2026-03-29 10:38:07 [auto1.de] INFO: Found listing with ID: WB93098
2026-03-29 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB93098%27 HTTP/1.1" 200 None
2026-03-29 10:38:07 [auto1.de] INFO: Scrape type for WB93098: 0
2026-03-29 10:38:07 [auto1.de] INFO: Found listing with ID: PE27175
2026-03-29 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE27175%27 HTTP/1.1" 200 None
2026-03-29 10:38:07 [auto1.de] INFO: Scrape type for PE27175: 0
2026-03-29 10:38:07 [auto1.de] INFO: Found listing with ID: SB37681
2026-03-29 10:38:07 [auto1.de] INFO: Found listing with ID: HJ62454
2026-03-29 10:38:07 [auto1.de] INFO: Found listing with ID: TN86054
2026-03-29 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN86054%27 HTTP/1.1" 200 None
2026-03-29 10:38:07 [auto1.de] INFO: Scrape type for TN86054: 0
2026-03-29 10:38:07 [auto1.de] INFO: Found listing with ID: SP41663
2026-03-29 10:38:07 [auto1.de] INFO: Found listing with ID: LZ26330
2026-03-29 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ26330%27 HTTP/1.1" 200 None
2026-03-29 10:38:07 [auto1.de] INFO: Scrape type for LZ26330: 0
2026-03-29 10:38:07 [auto1.de] INFO: Found listing with ID: PD80009
2026-03-29 10:38:07 [auto1.de] INFO: Found listing with ID: EF82631
2026-03-29 10:38:07 [auto1.de] INFO: Found listing with ID: PL48246
2026-03-29 10:38:07 [auto1.de] INFO: Found listing with ID: BN78852
2026-03-29 10:38:07 [auto1.de] INFO: Found listing with ID: DJ80434
2026-03-29 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ80434%27 HTTP/1.1" 200 None
2026-03-29 10:38:07 [auto1.de] INFO: Scrape type for DJ80434: 0
2026-03-29 10:38:07 [auto1.de] INFO: Found listing with ID: KL70058
2026-03-29 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL70058%27 HTTP/1.1" 200 None
2026-03-29 10:38:07 [auto1.de] INFO: Scrape type for KL70058: 0
2026-03-29 10:38:07 [auto1.de] INFO: Found listing with ID: CS56497
2026-03-29 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS56497%27 HTTP/1.1" 200 None
2026-03-29 10:38:08 [auto1.de] INFO: Scrape type for CS56497: 0
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: LS72141
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: ZZ01082
2026-03-29 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ01082%27 HTTP/1.1" 200 None
2026-03-29 10:38:08 [auto1.de] INFO: Scrape type for ZZ01082: 0
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: ZB97674
2026-03-29 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB97674%27 HTTP/1.1" 200 None
2026-03-29 10:38:08 [auto1.de] INFO: Scrape type for ZB97674: 0
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: MB83489
2026-03-29 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB83489%27 HTTP/1.1" 200 None
2026-03-29 10:38:08 [auto1.de] INFO: Scrape type for MB83489: 0
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: BZ96817
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: GE94001
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: DV51967
2026-03-29 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV51967%27 HTTP/1.1" 200 None
2026-03-29 10:38:08 [auto1.de] INFO: Scrape type for DV51967: 0
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: TD26953
2026-03-29 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD26953%27 HTTP/1.1" 200 None
2026-03-29 10:38:08 [auto1.de] INFO: Scrape type for TD26953: 0
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: TM98978
2026-03-29 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM98978%27 HTTP/1.1" 200 None
2026-03-29 10:38:08 [auto1.de] INFO: Scrape type for TM98978: 0
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: CM83282
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: UJ33462
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: EJ40099
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: CV29491
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: AC85459
2026-03-29 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC85459%27 HTTP/1.1" 200 None
2026-03-29 10:38:08 [auto1.de] INFO: Scrape type for AC85459: 0
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: RS52465
2026-03-29 10:38:08 [auto1.de] INFO: Found listing with ID: NU76337
2026-03-29 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU76337%27 HTTP/1.1" 200 None
2026-03-29 10:38:08 [auto1.de] INFO: Scrape type for NU76337: 0
2026-03-29 10:38:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:09 [auto1.de] INFO: Channel: 24h | Page: 28 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: BN23533
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN23533%27 HTTP/1.1" 200 None
2026-03-29 10:38:09 [auto1.de] INFO: Scrape type for BN23533: 0
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: BS44912
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS44912%27 HTTP/1.1" 200 None
2026-03-29 10:38:09 [auto1.de] INFO: Scrape type for BS44912: 0
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: HA98993
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA98993%27 HTTP/1.1" 200 None
2026-03-29 10:38:09 [auto1.de] INFO: Scrape type for HA98993: 0
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: SA82708
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA82708%27 HTTP/1.1" 200 None
2026-03-29 10:38:09 [auto1.de] INFO: Scrape type for SA82708: 0
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: XT50939
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT50939%27 HTTP/1.1" 200 None
2026-03-29 10:38:09 [auto1.de] INFO: Scrape type for XT50939: 0
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: XW85438
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: GJ72633
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: WE78461
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: BB70854
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: VP85116
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: JA25299
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA25299%27 HTTP/1.1" 200 None
2026-03-29 10:38:09 [auto1.de] INFO: Scrape type for JA25299: 0
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: PC67993
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC67993%27 HTTP/1.1" 200 None
2026-03-29 10:38:09 [auto1.de] INFO: Scrape type for PC67993: 0
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: GS38799
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS38799%27 HTTP/1.1" 200 None
2026-03-29 10:38:09 [auto1.de] INFO: Scrape type for GS38799: 0
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: ZC13254
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC13254%27 HTTP/1.1" 200 None
2026-03-29 10:38:09 [auto1.de] INFO: Scrape type for ZC13254: 0
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: AJ88373
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: ZM17001
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: HA43942
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: WW51915
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW51915%27 HTTP/1.1" 200 None
2026-03-29 10:38:09 [auto1.de] INFO: Scrape type for WW51915: 0
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: CU54451
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU54451%27 HTTP/1.1" 200 None
2026-03-29 10:38:09 [auto1.de] INFO: Scrape type for CU54451: 0
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: FN85650
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN85650%27 HTTP/1.1" 200 None
2026-03-29 10:38:09 [auto1.de] INFO: Scrape type for FN85650: 0
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: WX50182
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: DU31630
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: KF91285
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: FV09122
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV09122%27 HTTP/1.1" 200 None
2026-03-29 10:38:09 [auto1.de] INFO: Scrape type for FV09122: 0
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: SE25361
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: DF17432
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: SA80165
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA80165%27 HTTP/1.1" 200 None
2026-03-29 10:38:09 [auto1.de] INFO: Scrape type for SA80165: 0
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: EN46705
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: WA68072
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: CD93100
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: RU29030
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU29030%27 HTTP/1.1" 200 None
2026-03-29 10:38:09 [auto1.de] INFO: Scrape type for RU29030: 0
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: HD36706
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD36706%27 HTTP/1.1" 200 None
2026-03-29 10:38:09 [auto1.de] INFO: Scrape type for HD36706: 0
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: XY49734
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY49734%27 HTTP/1.1" 200 None
2026-03-29 10:38:09 [auto1.de] INFO: Scrape type for XY49734: 0
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: NN32284
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN32284%27 HTTP/1.1" 200 None
2026-03-29 10:38:09 [auto1.de] INFO: Scrape type for NN32284: 0
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: MM33078
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM33078%27 HTTP/1.1" 200 None
2026-03-29 10:38:09 [auto1.de] INFO: Scrape type for MM33078: 0
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: LV55209
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: LD01626
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD01626%27 HTTP/1.1" 200 None
2026-03-29 10:38:09 [auto1.de] INFO: Scrape type for LD01626: 0
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: JV32404
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: LC33794
2026-03-29 10:38:09 [auto1.de] INFO: Found listing with ID: RU43264
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU43264%27 HTTP/1.1" 200 None
2026-03-29 10:38:09 [auto1.de] INFO: Scrape type for RU43264: 0
2026-03-29 10:38:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:10 [auto1.de] INFO: Channel: 24h | Page: 29 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: HP02844
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: JY04435
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: VF70690
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF70690%27 HTTP/1.1" 200 None
2026-03-29 10:38:10 [auto1.de] INFO: Scrape type for VF70690: 0
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: CP54704
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP54704%27 HTTP/1.1" 200 None
2026-03-29 10:38:10 [auto1.de] INFO: Scrape type for CP54704: 0
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: FG21922
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG21922%27 HTTP/1.1" 200 None
2026-03-29 10:38:10 [auto1.de] INFO: Scrape type for FG21922: 0
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: SE90361
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE90361%27 HTTP/1.1" 200 None
2026-03-29 10:38:10 [auto1.de] INFO: Scrape type for SE90361: 0
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: TA32254
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: JB35967
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB35967%27 HTTP/1.1" 200 None
2026-03-29 10:38:10 [auto1.de] INFO: Scrape type for JB35967: 0
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: RD63050
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: FK33509
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: RM28655
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: ZS56665
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS56665%27 HTTP/1.1" 200 None
2026-03-29 10:38:10 [auto1.de] INFO: Scrape type for ZS56665: 0
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: YM40569
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM40569%27 HTTP/1.1" 200 None
2026-03-29 10:38:10 [auto1.de] INFO: Scrape type for YM40569: 0
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: KC35382
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: WX73478
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: EV72489
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV72489%27 HTTP/1.1" 200 None
2026-03-29 10:38:10 [auto1.de] INFO: Scrape type for EV72489: 0
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: DH40869
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: CF89653
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF89653%27 HTTP/1.1" 200 None
2026-03-29 10:38:10 [auto1.de] INFO: Scrape type for CF89653: 0
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: WG70910
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: WB04317
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB04317%27 HTTP/1.1" 200 None
2026-03-29 10:38:10 [auto1.de] INFO: Scrape type for WB04317: 0
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: ET31330
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET31330%27 HTTP/1.1" 200 None
2026-03-29 10:38:10 [auto1.de] INFO: Scrape type for ET31330: 0
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: LB57303
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: CK29715
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: WT17427
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: DX86501
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: RC50586
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC50586%27 HTTP/1.1" 200 None
2026-03-29 10:38:10 [auto1.de] INFO: Scrape type for RC50586: 0
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: SJ63454
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ63454%27 HTTP/1.1" 200 None
2026-03-29 10:38:10 [auto1.de] INFO: Scrape type for SJ63454: 0
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: VY38504
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: JH21308
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: TB88794
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: FA01437
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: SA69574
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: BB54670
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: XY94981
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: LD78025
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD78025%27 HTTP/1.1" 200 None
2026-03-29 10:38:10 [auto1.de] INFO: Scrape type for LD78025: 0
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: AR19685
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR19685%27 HTTP/1.1" 200 None
2026-03-29 10:38:10 [auto1.de] INFO: Scrape type for AR19685: 0
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: JH65606
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: HD83134
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD83134%27 HTTP/1.1" 200 None
2026-03-29 10:38:10 [auto1.de] INFO: Scrape type for HD83134: 0
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: DB25597
2026-03-29 10:38:10 [auto1.de] INFO: Found listing with ID: ZN44804
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN44804%27 HTTP/1.1" 200 None
2026-03-29 10:38:10 [auto1.de] INFO: Scrape type for ZN44804: 0
2026-03-29 10:38:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:12 [auto1.de] INFO: Channel: 24h | Page: 30 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:12 [auto1.de] INFO: Found listing with ID: YZ38333
2026-03-29 10:38:12 [auto1.de] INFO: Found listing with ID: NG28413
2026-03-29 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG28413%27 HTTP/1.1" 200 None
2026-03-29 10:38:12 [auto1.de] INFO: Scrape type for NG28413: 0
2026-03-29 10:38:12 [auto1.de] INFO: Found listing with ID: JV68298
2026-03-29 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68298%27 HTTP/1.1" 200 None
2026-03-29 10:38:12 [auto1.de] INFO: Scrape type for JV68298: 0
2026-03-29 10:38:12 [auto1.de] INFO: Found listing with ID: JM73266
2026-03-29 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM73266%27 HTTP/1.1" 200 None
2026-03-29 10:38:12 [auto1.de] INFO: Scrape type for JM73266: 0
2026-03-29 10:38:12 [auto1.de] INFO: Found listing with ID: SP19687
2026-03-29 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP19687%27 HTTP/1.1" 200 None
2026-03-29 10:38:12 [auto1.de] INFO: Scrape type for SP19687: 0
2026-03-29 10:38:12 [auto1.de] INFO: Found listing with ID: BP33481
2026-03-29 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP33481%27 HTTP/1.1" 200 None
2026-03-29 10:38:12 [auto1.de] INFO: Scrape type for BP33481: 0
2026-03-29 10:38:12 [auto1.de] INFO: Found listing with ID: DR66726
2026-03-29 10:38:12 [auto1.de] INFO: Found listing with ID: GG14507
2026-03-29 10:38:12 [auto1.de] INFO: Found listing with ID: LB09285
2026-03-29 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB09285%27 HTTP/1.1" 200 None
2026-03-29 10:38:12 [auto1.de] INFO: Scrape type for LB09285: 0
2026-03-29 10:38:12 [auto1.de] INFO: Found listing with ID: VG84958
2026-03-29 10:38:12 [auto1.de] INFO: Found listing with ID: WL40040
2026-03-29 10:38:12 [auto1.de] INFO: Found listing with ID: EH25554
2026-03-29 10:38:12 [auto1.de] INFO: Found listing with ID: JT97344
2026-03-29 10:38:12 [auto1.de] INFO: Found listing with ID: WG00954
2026-03-29 10:38:12 [auto1.de] INFO: Found listing with ID: CM50859
2026-03-29 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM50859%27 HTTP/1.1" 200 None
2026-03-29 10:38:12 [auto1.de] INFO: Scrape type for CM50859: 0
2026-03-29 10:38:12 [auto1.de] INFO: Found listing with ID: YK88723
2026-03-29 10:38:12 [auto1.de] INFO: Found listing with ID: ME09470
2026-03-29 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME09470%27 HTTP/1.1" 200 None
2026-03-29 10:38:12 [auto1.de] INFO: Scrape type for ME09470: 0
2026-03-29 10:38:12 [auto1.de] INFO: Found listing with ID: TF89419
2026-03-29 10:38:12 [auto1.de] INFO: Found listing with ID: WW45885
2026-03-29 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW45885%27 HTTP/1.1" 200 None
2026-03-29 10:38:12 [auto1.de] INFO: Scrape type for WW45885: 0
2026-03-29 10:38:12 [auto1.de] INFO: Found listing with ID: AW26352
2026-03-29 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW26352%27 HTTP/1.1" 200 None
2026-03-29 10:38:12 [auto1.de] INFO: Scrape type for AW26352: 0
2026-03-29 10:38:12 [auto1.de] INFO: Found listing with ID: LF15442
2026-03-29 10:38:12 [auto1.de] INFO: Found listing with ID: HP18010
2026-03-29 10:38:12 [auto1.de] INFO: Found listing with ID: HJ54596
2026-03-29 10:38:12 [auto1.de] INFO: Found listing with ID: MR23018
2026-03-29 10:38:12 [auto1.de] INFO: Found listing with ID: RM40239
2026-03-29 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM40239%27 HTTP/1.1" 200 None
2026-03-29 10:38:12 [auto1.de] INFO: Scrape type for RM40239: 0
2026-03-29 10:38:12 [auto1.de] INFO: Found listing with ID: GG36618
2026-03-29 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG36618%27 HTTP/1.1" 200 None
2026-03-29 10:38:12 [auto1.de] INFO: Scrape type for GG36618: 0
2026-03-29 10:38:12 [auto1.de] INFO: Found listing with ID: JL88490
2026-03-29 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL88490%27 HTTP/1.1" 200 None
2026-03-29 10:38:12 [auto1.de] INFO: Scrape type for JL88490: 0
2026-03-29 10:38:12 [auto1.de] INFO: Found listing with ID: BU23510
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU23510%27 HTTP/1.1" 200 None
2026-03-29 10:38:13 [auto1.de] INFO: Scrape type for BU23510: 0
2026-03-29 10:38:13 [auto1.de] INFO: Found listing with ID: RE53759
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE53759%27 HTTP/1.1" 200 None
2026-03-29 10:38:13 [auto1.de] INFO: Scrape type for RE53759: 0
2026-03-29 10:38:13 [auto1.de] INFO: Found listing with ID: HP87000
2026-03-29 10:38:13 [auto1.de] INFO: Found listing with ID: PH48180
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH48180%27 HTTP/1.1" 200 None
2026-03-29 10:38:13 [auto1.de] INFO: Scrape type for PH48180: 0
2026-03-29 10:38:13 [auto1.de] INFO: Found listing with ID: NV31897
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV31897%27 HTTP/1.1" 200 None
2026-03-29 10:38:13 [auto1.de] INFO: Scrape type for NV31897: 0
2026-03-29 10:38:13 [auto1.de] INFO: Found listing with ID: VW42745
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW42745%27 HTTP/1.1" 200 None
2026-03-29 10:38:13 [auto1.de] INFO: Scrape type for VW42745: 0
2026-03-29 10:38:13 [auto1.de] INFO: Found listing with ID: HZ35615
2026-03-29 10:38:13 [auto1.de] INFO: Found listing with ID: YJ99770
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ99770%27 HTTP/1.1" 200 None
2026-03-29 10:38:13 [auto1.de] INFO: Scrape type for YJ99770: 0
2026-03-29 10:38:13 [auto1.de] INFO: Found listing with ID: SK99321
2026-03-29 10:38:13 [auto1.de] INFO: Found listing with ID: ZT89563
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT89563%27 HTTP/1.1" 200 None
2026-03-29 10:38:13 [auto1.de] INFO: Scrape type for ZT89563: 0
2026-03-29 10:38:13 [auto1.de] INFO: Found listing with ID: HJ11294
2026-03-29 10:38:13 [auto1.de] INFO: Found listing with ID: PW77910
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW77910%27 HTTP/1.1" 200 None
2026-03-29 10:38:13 [auto1.de] INFO: Scrape type for PW77910: 0
2026-03-29 10:38:13 [auto1.de] INFO: Found listing with ID: ER42295
2026-03-29 10:38:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:14 [auto1.de] INFO: Channel: 24h | Page: 31 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: TE93454
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE93454%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Scrape type for TE93454: 0
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: FH45720
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH45720%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Scrape type for FH45720: 0
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: MR37276
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR37276%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Scrape type for MR37276: 0
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: PU00921
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU00921%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Scrape type for PU00921: 0
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: VY10648
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY10648%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Scrape type for VY10648: 0
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: UY72197
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY72197%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Scrape type for UY72197: 0
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: SL53901
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: FY91836
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY91836%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Scrape type for FY91836: 0
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: PH88741
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH88741%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Scrape type for PH88741: 0
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: DC59357
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: VK44645
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK44645%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Scrape type for VK44645: 0
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: HF07638
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF07638%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Scrape type for HF07638: 0
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: BF26414
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF26414%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Scrape type for BF26414: 0
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: DW94281
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: VD47640
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: VP46416
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP46416%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Scrape type for VP46416: 0
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: UV26569
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: RJ47669
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ47669%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Scrape type for RJ47669: 0
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: LD15809
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: CF53394
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF53394%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Scrape type for CF53394: 0
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: KV36004
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: MV55154
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV55154%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Scrape type for MV55154: 0
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: TW15848
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW15848%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Scrape type for TW15848: 0
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: WZ38880
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ38880%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Scrape type for WZ38880: 0
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: CZ73559
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ73559%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Scrape type for CZ73559: 0
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: TH75068
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: JZ25562
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: DV41165
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV41165%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Scrape type for DV41165: 0
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: JZ96778
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: AK64805
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK64805%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Scrape type for AK64805: 0
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: GA31373
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA31373%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Scrape type for GA31373: 0
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: EX84018
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: SX95086
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: AL93555
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: ZF74811
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: EP44160
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP44160%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Scrape type for EP44160: 0
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: TC06569
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC06569%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Scrape type for TC06569: 0
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: KE98572
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: JC98855
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC98855%27 HTTP/1.1" 200 None
2026-03-29 10:38:14 [auto1.de] INFO: Scrape type for JC98855: 0
2026-03-29 10:38:14 [auto1.de] INFO: Found listing with ID: WE09519
2026-03-29 10:38:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:15 [auto1.de] INFO: Channel: 24h | Page: 32 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: CF84548
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: HE96933
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: JD70113
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: BP97465
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP97465%27 HTTP/1.1" 200 None
2026-03-29 10:38:15 [auto1.de] INFO: Scrape type for BP97465: 0
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: TH33543
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH33543%27 HTTP/1.1" 200 None
2026-03-29 10:38:15 [auto1.de] INFO: Scrape type for TH33543: 0
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: LP44310
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP44310%27 HTTP/1.1" 200 None
2026-03-29 10:38:15 [auto1.de] INFO: Scrape type for LP44310: 0
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: TD06456
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: XT71149
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: CL90320
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL90320%27 HTTP/1.1" 200 None
2026-03-29 10:38:15 [auto1.de] INFO: Scrape type for CL90320: 0
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: NS14523
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: NU38157
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: JV77194
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: DG73044
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: AB72988
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: LS65332
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS65332%27 HTTP/1.1" 200 None
2026-03-29 10:38:15 [auto1.de] INFO: Scrape type for LS65332: 0
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: BA31495
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: XN26589
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: ND38532
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND38532%27 HTTP/1.1" 200 None
2026-03-29 10:38:15 [auto1.de] INFO: Scrape type for ND38532: 0
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: PL79897
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL79897%27 HTTP/1.1" 200 None
2026-03-29 10:38:15 [auto1.de] INFO: Scrape type for PL79897: 0
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: LJ53831
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: UL11203
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: AE93045
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: US43373
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US43373%27 HTTP/1.1" 200 None
2026-03-29 10:38:15 [auto1.de] INFO: Scrape type for US43373: 0
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: ZL30949
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: SA82608
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: BZ78567
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: PW65541
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW65541%27 HTTP/1.1" 200 None
2026-03-29 10:38:15 [auto1.de] INFO: Scrape type for PW65541: 0
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: WG96363
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: ZC62608
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: VV98956
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV98956%27 HTTP/1.1" 200 None
2026-03-29 10:38:15 [auto1.de] INFO: Scrape type for VV98956: 0
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: PS52652
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: CS48399
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS48399%27 HTTP/1.1" 200 None
2026-03-29 10:38:15 [auto1.de] INFO: Scrape type for CS48399: 0
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: HY33546
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY33546%27 HTTP/1.1" 200 None
2026-03-29 10:38:15 [auto1.de] INFO: Scrape type for HY33546: 0
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: CP99772
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: XP82440
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP82440%27 HTTP/1.1" 200 None
2026-03-29 10:38:15 [auto1.de] INFO: Scrape type for XP82440: 0
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: FM08350
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM08350%27 HTTP/1.1" 200 None
2026-03-29 10:38:15 [auto1.de] INFO: Scrape type for FM08350: 0
2026-03-29 10:38:15 [auto1.de] INFO: Found listing with ID: PF77212
2026-03-29 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF77212%27 HTTP/1.1" 200 None
2026-03-29 10:38:16 [auto1.de] INFO: Scrape type for PF77212: 0
2026-03-29 10:38:16 [auto1.de] INFO: Found listing with ID: WZ92700
2026-03-29 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ92700%27 HTTP/1.1" 200 None
2026-03-29 10:38:16 [auto1.de] INFO: Scrape type for WZ92700: 0
2026-03-29 10:38:16 [auto1.de] INFO: Found listing with ID: MU77879
2026-03-29 10:38:16 [auto1.de] INFO: Found listing with ID: BJ29098
2026-03-29 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ29098%27 HTTP/1.1" 200 None
2026-03-29 10:38:16 [auto1.de] INFO: Scrape type for BJ29098: 0
2026-03-29 10:38:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:17 [auto1.de] INFO: Channel: 24h | Page: 33 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: VJ44121
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: NN28121
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN28121%27 HTTP/1.1" 200 None
2026-03-29 10:38:17 [auto1.de] INFO: Scrape type for NN28121: 0
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: SY16661
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: PA80529
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA80529%27 HTTP/1.1" 200 None
2026-03-29 10:38:17 [auto1.de] INFO: Scrape type for PA80529: 0
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: FP11362
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP11362%27 HTTP/1.1" 200 None
2026-03-29 10:38:17 [auto1.de] INFO: Scrape type for FP11362: 0
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: DW77262
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: FD93722
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD93722%27 HTTP/1.1" 200 None
2026-03-29 10:38:17 [auto1.de] INFO: Scrape type for FD93722: 0
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: ZU03053
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU03053%27 HTTP/1.1" 200 None
2026-03-29 10:38:17 [auto1.de] INFO: Scrape type for ZU03053: 0
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: WG69866
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG69866%27 HTTP/1.1" 200 None
2026-03-29 10:38:17 [auto1.de] INFO: Scrape type for WG69866: 0
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: RD35105
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD35105%27 HTTP/1.1" 200 None
2026-03-29 10:38:17 [auto1.de] INFO: Scrape type for RD35105: 0
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: ZV21910
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV21910%27 HTTP/1.1" 200 None
2026-03-29 10:38:17 [auto1.de] INFO: Scrape type for ZV21910: 0
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: BA65327
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA65327%27 HTTP/1.1" 200 None
2026-03-29 10:38:17 [auto1.de] INFO: Scrape type for BA65327: 0
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: FZ49091
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: SJ72681
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ72681%27 HTTP/1.1" 200 None
2026-03-29 10:38:17 [auto1.de] INFO: Scrape type for SJ72681: 0
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: PW56805
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: GW52920
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW52920%27 HTTP/1.1" 200 None
2026-03-29 10:38:17 [auto1.de] INFO: Scrape type for GW52920: 0
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: KS48100
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS48100%27 HTTP/1.1" 200 None
2026-03-29 10:38:17 [auto1.de] INFO: Scrape type for KS48100: 0
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: SX14499
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX14499%27 HTTP/1.1" 200 None
2026-03-29 10:38:17 [auto1.de] INFO: Scrape type for SX14499: 0
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: VN95277
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: ZC04825
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC04825%27 HTTP/1.1" 200 None
2026-03-29 10:38:17 [auto1.de] INFO: Scrape type for ZC04825: 0
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: XB91859
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: GF62239
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: TA56984
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA56984%27 HTTP/1.1" 200 None
2026-03-29 10:38:17 [auto1.de] INFO: Scrape type for TA56984: 0
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: HL01818
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: UL81757
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: CS17953
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS17953%27 HTTP/1.1" 200 None
2026-03-29 10:38:17 [auto1.de] INFO: Scrape type for CS17953: 0
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: EL73218
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: BH53134
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH53134%27 HTTP/1.1" 200 None
2026-03-29 10:38:17 [auto1.de] INFO: Scrape type for BH53134: 0
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: BV55429
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: HV61627
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: VJ38627
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ38627%27 HTTP/1.1" 200 None
2026-03-29 10:38:17 [auto1.de] INFO: Scrape type for VJ38627: 0
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: EC33073
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: VJ57461
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: WK71622
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK71622%27 HTTP/1.1" 200 None
2026-03-29 10:38:17 [auto1.de] INFO: Scrape type for WK71622: 0
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: ZW06761
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: ZE48308
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE48308%27 HTTP/1.1" 200 None
2026-03-29 10:38:17 [auto1.de] INFO: Scrape type for ZE48308: 0
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: XP46424
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP46424%27 HTTP/1.1" 200 None
2026-03-29 10:38:17 [auto1.de] INFO: Scrape type for XP46424: 0
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: BY55773
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY55773%27 HTTP/1.1" 200 None
2026-03-29 10:38:17 [auto1.de] INFO: Scrape type for BY55773: 0
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: TY49191
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY49191%27 HTTP/1.1" 200 None
2026-03-29 10:38:17 [auto1.de] INFO: Scrape type for TY49191: 0
2026-03-29 10:38:17 [auto1.de] INFO: Found listing with ID: KB43733
2026-03-29 10:38:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:18 [auto1.de] INFO: Channel: 24h | Page: 34 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: KZ61703
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ61703%27 HTTP/1.1" 200 None
2026-03-29 10:38:18 [auto1.de] INFO: Scrape type for KZ61703: 0
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: XC13487
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: AZ92098
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: JL05117
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: UH96912
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH96912%27 HTTP/1.1" 200 None
2026-03-29 10:38:18 [auto1.de] INFO: Scrape type for UH96912: 0
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: MY92722
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY92722%27 HTTP/1.1" 200 None
2026-03-29 10:38:18 [auto1.de] INFO: Scrape type for MY92722: 0
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: LU22691
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: HV25811
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV25811%27 HTTP/1.1" 200 None
2026-03-29 10:38:18 [auto1.de] INFO: Scrape type for HV25811: 0
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: JP14233
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: AZ14861
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: UH00039
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH00039%27 HTTP/1.1" 200 None
2026-03-29 10:38:18 [auto1.de] INFO: Scrape type for UH00039: 0
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: GA28860
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA28860%27 HTTP/1.1" 200 None
2026-03-29 10:38:18 [auto1.de] INFO: Scrape type for GA28860: 0
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: HG25993
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG25993%27 HTTP/1.1" 200 None
2026-03-29 10:38:18 [auto1.de] INFO: Scrape type for HG25993: 0
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: UF45337
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF45337%27 HTTP/1.1" 200 None
2026-03-29 10:38:18 [auto1.de] INFO: Scrape type for UF45337: 0
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: JH35819
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH35819%27 HTTP/1.1" 200 None
2026-03-29 10:38:18 [auto1.de] INFO: Scrape type for JH35819: 0
2026-03-29 10:38:18 [auto1.de] INFO: Found listing with ID: RF22787
2026-03-29 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF22787%27 HTTP/1.1" 200 None
2026-03-29 10:38:19 [auto1.de] INFO: Scrape type for RF22787: 0
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: KS23837
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: GA19207
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: PR95726
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR95726%27 HTTP/1.1" 200 None
2026-03-29 10:38:19 [auto1.de] INFO: Scrape type for PR95726: 0
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: HM43288
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM43288%27 HTTP/1.1" 200 None
2026-03-29 10:38:19 [auto1.de] INFO: Scrape type for HM43288: 0
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: CR29385
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: LB66833
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB66833%27 HTTP/1.1" 200 None
2026-03-29 10:38:19 [auto1.de] INFO: Scrape type for LB66833: 0
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: BZ12111
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ12111%27 HTTP/1.1" 200 None
2026-03-29 10:38:19 [auto1.de] INFO: Scrape type for BZ12111: 0
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: HF53882
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: SS89253
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: GA77532
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: MG70959
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG70959%27 HTTP/1.1" 200 None
2026-03-29 10:38:19 [auto1.de] INFO: Scrape type for MG70959: 0
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: WN72573
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: ZF28924
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF28924%27 HTTP/1.1" 200 None
2026-03-29 10:38:19 [auto1.de] INFO: Scrape type for ZF28924: 0
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: HV14674
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: DJ14237
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ14237%27 HTTP/1.1" 200 None
2026-03-29 10:38:19 [auto1.de] INFO: Scrape type for DJ14237: 0
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: AE42693
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: LN88860
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN88860%27 HTTP/1.1" 200 None
2026-03-29 10:38:19 [auto1.de] INFO: Scrape type for LN88860: 0
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: VN01043
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN01043%27 HTTP/1.1" 200 None
2026-03-29 10:38:19 [auto1.de] INFO: Scrape type for VN01043: 0
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: DN26053
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: EV58982
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV58982%27 HTTP/1.1" 200 None
2026-03-29 10:38:19 [auto1.de] INFO: Scrape type for EV58982: 0
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: PC60624
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: PN56757
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN56757%27 HTTP/1.1" 200 None
2026-03-29 10:38:19 [auto1.de] INFO: Scrape type for PN56757: 0
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: PJ54145
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ54145%27 HTTP/1.1" 200 None
2026-03-29 10:38:19 [auto1.de] INFO: Scrape type for PJ54145: 0
2026-03-29 10:38:19 [auto1.de] INFO: Found listing with ID: CH75769
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH75769%27 HTTP/1.1" 200 None
2026-03-29 10:38:19 [auto1.de] INFO: Scrape type for CH75769: 0
2026-03-29 10:38:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:20 [auto1.de] INFO: Channel: 24h | Page: 35 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:20 [auto1.de] INFO: Found listing with ID: NJ46216
2026-03-29 10:38:20 [auto1.de] INFO: Found listing with ID: NY21217
2026-03-29 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY21217%27 HTTP/1.1" 200 None
2026-03-29 10:38:20 [auto1.de] INFO: Scrape type for NY21217: 0
2026-03-29 10:38:20 [auto1.de] INFO: Found listing with ID: KH16310
2026-03-29 10:38:20 [auto1.de] INFO: Found listing with ID: UH34905
2026-03-29 10:38:20 [auto1.de] INFO: Found listing with ID: KE72170
2026-03-29 10:38:20 [auto1.de] INFO: Found listing with ID: ZV61779
2026-03-29 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV61779%27 HTTP/1.1" 200 None
2026-03-29 10:38:20 [auto1.de] INFO: Scrape type for ZV61779: 0
2026-03-29 10:38:20 [auto1.de] INFO: Found listing with ID: BH48904
2026-03-29 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH48904%27 HTTP/1.1" 200 None
2026-03-29 10:38:20 [auto1.de] INFO: Scrape type for BH48904: 0
2026-03-29 10:38:20 [auto1.de] INFO: Found listing with ID: AN13363
2026-03-29 10:38:20 [auto1.de] INFO: Found listing with ID: YM02183
2026-03-29 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM02183%27 HTTP/1.1" 200 None
2026-03-29 10:38:20 [auto1.de] INFO: Scrape type for YM02183: 0
2026-03-29 10:38:20 [auto1.de] INFO: Found listing with ID: VB62953
2026-03-29 10:38:20 [auto1.de] INFO: Found listing with ID: WS48624
2026-03-29 10:38:20 [auto1.de] INFO: Found listing with ID: LC91854
2026-03-29 10:38:20 [auto1.de] INFO: Found listing with ID: TZ67975
2026-03-29 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ67975%27 HTTP/1.1" 200 None
2026-03-29 10:38:20 [auto1.de] INFO: Scrape type for TZ67975: 2
2026-03-29 10:38:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f149faa4-5cb3-5739-acd3-02b9fc6747d1 with identifier: TZ67975
2026-03-29 10:38:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f149faa4-5cb3-5739-acd3-02b9fc6747d1 with scrape type 2
2026-03-29 10:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f149faa4-5cb3-5739-acd3-02b9fc6747d1 with scrape type 2
2026-03-29 10:38:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f149faa4-5cb3-5739-acd3-02b9fc6747d1, identifier: TZ67975
2026-03-29 10:38:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f149faa4-5cb3-5739-acd3-02b9fc6747d1 with identifier: TZ67975
2026-03-29 10:38:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f149faa4-5cb3-5739-acd3-02b9fc6747d1 with identifier: TZ67975
2026-03-29 10:38:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f149faa4-5cb3-5739-acd3-02b9fc6747d1 with identifier: TZ67975 to the API
2026-03-29 10:38:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:38:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:20:51Z',
 'fuel_type': 'petrol',
 'id': 'f149faa4-5cb3-5739-acd3-02b9fc6747d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ67975',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 138621,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-11',
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2009}
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ67975%27 HTTP/1.1" 200 None
2026-03-29 10:38:21 [auto1.de] INFO: Saving data for TZ67975: {'auction_closing_time': 1774884051.0, 'created_time': 1774596938.054236, 'last_price_update_time': 1774780701.281399}
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TZ67975') HTTP/1.1" 204 0
2026-03-29 10:38:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: AE20511
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE20511%27 HTTP/1.1" 200 None
2026-03-29 10:38:21 [auto1.de] INFO: Scrape type for AE20511: 0
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: SY85938
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: YY45695
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: PF14640
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF14640%27 HTTP/1.1" 200 None
2026-03-29 10:38:21 [auto1.de] INFO: Scrape type for PF14640: 0
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: WV15803
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV15803%27 HTTP/1.1" 200 None
2026-03-29 10:38:21 [auto1.de] INFO: Scrape type for WV15803: 0
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: HM75653
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM75653%27 HTTP/1.1" 200 None
2026-03-29 10:38:21 [auto1.de] INFO: Scrape type for HM75653: 0
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: DF94308
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF94308%27 HTTP/1.1" 200 None
2026-03-29 10:38:21 [auto1.de] INFO: Scrape type for DF94308: 0
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: UB45914
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: ZM88975
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: EB91533
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: UH43382
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: EE00996
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE00996%27 HTTP/1.1" 200 None
2026-03-29 10:38:21 [auto1.de] INFO: Scrape type for EE00996: 0
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: NW86422
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: WN92632
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: NT28876
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT28876%27 HTTP/1.1" 200 None
2026-03-29 10:38:21 [auto1.de] INFO: Scrape type for NT28876: 0
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: PS83332
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS83332%27 HTTP/1.1" 200 None
2026-03-29 10:38:21 [auto1.de] INFO: Scrape type for PS83332: 0
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: LJ18760
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: TT83472
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT83472%27 HTTP/1.1" 200 None
2026-03-29 10:38:21 [auto1.de] INFO: Scrape type for TT83472: 0
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: FS00408
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS00408%27 HTTP/1.1" 200 None
2026-03-29 10:38:21 [auto1.de] INFO: Scrape type for FS00408: 0
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: EU98596
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: YH81029
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: BY26961
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: WE65713
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE65713%27 HTTP/1.1" 200 None
2026-03-29 10:38:21 [auto1.de] INFO: Scrape type for WE65713: 0
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: AR04951
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR04951%27 HTTP/1.1" 200 None
2026-03-29 10:38:21 [auto1.de] INFO: Scrape type for AR04951: 0
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: CX50338
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX50338%27 HTTP/1.1" 200 None
2026-03-29 10:38:21 [auto1.de] INFO: Scrape type for CX50338: 0
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: HM36828
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM36828%27 HTTP/1.1" 200 None
2026-03-29 10:38:21 [auto1.de] INFO: Scrape type for HM36828: 0
2026-03-29 10:38:21 [auto1.de] INFO: Found listing with ID: HW87137
2026-03-29 10:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:22 [auto1.de] INFO: Channel: 24h | Page: 36 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:22 [auto1.de] INFO: Found listing with ID: RR77511
2026-03-29 10:38:22 [auto1.de] INFO: Found listing with ID: FD81187
2026-03-29 10:38:22 [auto1.de] INFO: Found listing with ID: TD54604
2026-03-29 10:38:22 [auto1.de] INFO: Found listing with ID: JM39243
2026-03-29 10:38:22 [auto1.de] INFO: Found listing with ID: VH61709
2026-03-29 10:38:22 [auto1.de] INFO: Found listing with ID: RD48040
2026-03-29 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD48040%27 HTTP/1.1" 200 None
2026-03-29 10:38:22 [auto1.de] INFO: Scrape type for RD48040: 0
2026-03-29 10:38:22 [auto1.de] INFO: Found listing with ID: MT08770
2026-03-29 10:38:22 [auto1.de] INFO: Found listing with ID: CD05825
2026-03-29 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD05825%27 HTTP/1.1" 200 None
2026-03-29 10:38:22 [auto1.de] INFO: Scrape type for CD05825: 0
2026-03-29 10:38:22 [auto1.de] INFO: Found listing with ID: LN75673
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN75673%27 HTTP/1.1" 200 None
2026-03-29 10:38:23 [auto1.de] INFO: Scrape type for LN75673: 0
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: UM10671
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM10671%27 HTTP/1.1" 200 None
2026-03-29 10:38:23 [auto1.de] INFO: Scrape type for UM10671: 0
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: CD09262
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: JV89856
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV89856%27 HTTP/1.1" 200 None
2026-03-29 10:38:23 [auto1.de] INFO: Scrape type for JV89856: 0
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: SG95649
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: GX08405
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX08405%27 HTTP/1.1" 200 None
2026-03-29 10:38:23 [auto1.de] INFO: Scrape type for GX08405: 0
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: BL21282
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL21282%27 HTTP/1.1" 200 None
2026-03-29 10:38:23 [auto1.de] INFO: Scrape type for BL21282: 0
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: KU58060
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU58060%27 HTTP/1.1" 200 None
2026-03-29 10:38:23 [auto1.de] INFO: Scrape type for KU58060: 0
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: RG01801
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: HD41373
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD41373%27 HTTP/1.1" 200 None
2026-03-29 10:38:23 [auto1.de] INFO: Scrape type for HD41373: 0
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: DT85879
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: SH55749
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH55749%27 HTTP/1.1" 200 None
2026-03-29 10:38:23 [auto1.de] INFO: Scrape type for SH55749: 0
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: MY79904
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY79904%27 HTTP/1.1" 200 None
2026-03-29 10:38:23 [auto1.de] INFO: Scrape type for MY79904: 0
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: VU47138
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU47138%27 HTTP/1.1" 200 None
2026-03-29 10:38:23 [auto1.de] INFO: Scrape type for VU47138: 0
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: GT07597
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT07597%27 HTTP/1.1" 200 None
2026-03-29 10:38:23 [auto1.de] INFO: Scrape type for GT07597: 0
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: YA93761
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: AZ40865
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ40865%27 HTTP/1.1" 200 None
2026-03-29 10:38:23 [auto1.de] INFO: Scrape type for AZ40865: 0
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: JS20731
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: SG62181
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG62181%27 HTTP/1.1" 200 None
2026-03-29 10:38:23 [auto1.de] INFO: Scrape type for SG62181: 0
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: GS69685
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: AB35938
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB35938%27 HTTP/1.1" 200 None
2026-03-29 10:38:23 [auto1.de] INFO: Scrape type for AB35938: 0
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: TD57805
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD57805%27 HTTP/1.1" 200 None
2026-03-29 10:38:23 [auto1.de] INFO: Scrape type for TD57805: 0
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: BC03765
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC03765%27 HTTP/1.1" 200 None
2026-03-29 10:38:23 [auto1.de] INFO: Scrape type for BC03765: 0
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: SD97689
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: SP41921
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP41921%27 HTTP/1.1" 200 None
2026-03-29 10:38:23 [auto1.de] INFO: Scrape type for SP41921: 0
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: XB58662
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB58662%27 HTTP/1.1" 200 None
2026-03-29 10:38:23 [auto1.de] INFO: Scrape type for XB58662: 0
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: GA75258
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: ZJ78917
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: JP57699
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: SG28437
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: LB22457
2026-03-29 10:38:23 [auto1.de] INFO: Found listing with ID: YR74432
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR74432%27 HTTP/1.1" 200 None
2026-03-29 10:38:23 [auto1.de] INFO: Scrape type for YR74432: 0
2026-03-29 10:38:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:24 [auto1.de] INFO: Channel: 24h | Page: 37 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: AA51921
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: TE89273
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: SG66874
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG66874%27 HTTP/1.1" 200 None
2026-03-29 10:38:24 [auto1.de] INFO: Scrape type for SG66874: 0
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: HT62005
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: ZT71502
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: CZ05672
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ05672%27 HTTP/1.1" 200 None
2026-03-29 10:38:24 [auto1.de] INFO: Scrape type for CZ05672: 0
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: BT34315
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT34315%27 HTTP/1.1" 200 None
2026-03-29 10:38:24 [auto1.de] INFO: Scrape type for BT34315: 0
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: DL77544
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL77544%27 HTTP/1.1" 200 None
2026-03-29 10:38:24 [auto1.de] INFO: Scrape type for DL77544: 0
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: SL44411
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL44411%27 HTTP/1.1" 200 None
2026-03-29 10:38:24 [auto1.de] INFO: Scrape type for SL44411: 0
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: HB66964
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: LU00556
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: BK53036
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK53036%27 HTTP/1.1" 200 None
2026-03-29 10:38:24 [auto1.de] INFO: Scrape type for BK53036: 0
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: CF43434
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF43434%27 HTTP/1.1" 200 None
2026-03-29 10:38:24 [auto1.de] INFO: Scrape type for CF43434: 0
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: CU90865
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU90865%27 HTTP/1.1" 200 None
2026-03-29 10:38:24 [auto1.de] INFO: Scrape type for CU90865: 0
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: GB26744
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB26744%27 HTTP/1.1" 200 None
2026-03-29 10:38:24 [auto1.de] INFO: Scrape type for GB26744: 0
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: KH74255
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH74255%27 HTTP/1.1" 200 None
2026-03-29 10:38:24 [auto1.de] INFO: Scrape type for KH74255: 0
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: NM84530
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: NU04580
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU04580%27 HTTP/1.1" 200 None
2026-03-29 10:38:24 [auto1.de] INFO: Scrape type for NU04580: 0
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: TL23560
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL23560%27 HTTP/1.1" 200 None
2026-03-29 10:38:24 [auto1.de] INFO: Scrape type for TL23560: 0
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: BE47693
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE47693%27 HTTP/1.1" 200 None
2026-03-29 10:38:24 [auto1.de] INFO: Scrape type for BE47693: 0
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: RC68587
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: NX86319
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: VZ25719
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ25719%27 HTTP/1.1" 200 None
2026-03-29 10:38:24 [auto1.de] INFO: Scrape type for VZ25719: 0
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: KA82816
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA82816%27 HTTP/1.1" 200 None
2026-03-29 10:38:24 [auto1.de] INFO: Scrape type for KA82816: 0
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: UT22988
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT22988%27 HTTP/1.1" 200 None
2026-03-29 10:38:24 [auto1.de] INFO: Scrape type for UT22988: 0
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: BJ97003
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ97003%27 HTTP/1.1" 200 None
2026-03-29 10:38:24 [auto1.de] INFO: Scrape type for BJ97003: 0
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: KY27003
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: WZ51755
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: XV87595
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: TU42295
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: ZX84007
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: KR20197
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: FV50908
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: LP76245
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP76245%27 HTTP/1.1" 200 None
2026-03-29 10:38:24 [auto1.de] INFO: Scrape type for LP76245: 0
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: NT47170
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: CC55438
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: WP14042
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP14042%27 HTTP/1.1" 200 None
2026-03-29 10:38:24 [auto1.de] INFO: Scrape type for WP14042: 0
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: SC87676
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: MH70992
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH70992%27 HTTP/1.1" 200 None
2026-03-29 10:38:24 [auto1.de] INFO: Scrape type for MH70992: 0
2026-03-29 10:38:24 [auto1.de] INFO: Found listing with ID: EC33750
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC33750%27 HTTP/1.1" 200 None
2026-03-29 10:38:24 [auto1.de] INFO: Scrape type for EC33750: 0
2026-03-29 10:38:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:25 [auto1.de] INFO: Channel: 24h | Page: 38 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: RN81514
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: JC28332
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC28332%27 HTTP/1.1" 200 None
2026-03-29 10:38:25 [auto1.de] INFO: Scrape type for JC28332: 0
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: GY96570
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: HN44091
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN44091%27 HTTP/1.1" 200 None
2026-03-29 10:38:25 [auto1.de] INFO: Scrape type for HN44091: 0
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: AB27737
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB27737%27 HTTP/1.1" 200 None
2026-03-29 10:38:25 [auto1.de] INFO: Scrape type for AB27737: 0
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: AB91647
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB91647%27 HTTP/1.1" 200 None
2026-03-29 10:38:25 [auto1.de] INFO: Scrape type for AB91647: 0
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: UC60552
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: HM57840
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM57840%27 HTTP/1.1" 200 None
2026-03-29 10:38:25 [auto1.de] INFO: Scrape type for HM57840: 0
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: DX68266
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: FY99153
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: AM15816
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM15816%27 HTTP/1.1" 200 None
2026-03-29 10:38:25 [auto1.de] INFO: Scrape type for AM15816: 0
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: AX08023
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX08023%27 HTTP/1.1" 200 None
2026-03-29 10:38:25 [auto1.de] INFO: Scrape type for AX08023: 0
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: MM43491
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: SA10285
2026-03-29 10:38:25 [auto1.de] INFO: Found listing with ID: YE15667
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE15667%27 HTTP/1.1" 200 None
2026-03-29 10:38:25 [auto1.de] INFO: Scrape type for YE15667: 2
2026-03-29 10:38:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f90855a8-5853-5d95-a239-7d83c663eda1 with identifier: YE15667
2026-03-29 10:38:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f90855a8-5853-5d95-a239-7d83c663eda1 with scrape type 2
2026-03-29 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f90855a8-5853-5d95-a239-7d83c663eda1 with scrape type 2
2026-03-29 10:38:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f90855a8-5853-5d95-a239-7d83c663eda1, identifier: YE15667
2026-03-29 10:38:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f90855a8-5853-5d95-a239-7d83c663eda1 with identifier: YE15667
2026-03-29 10:38:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f90855a8-5853-5d95-a239-7d83c663eda1 with identifier: YE15667
2026-03-29 10:38:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f90855a8-5853-5d95-a239-7d83c663eda1 with identifier: YE15667 to the API
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:38:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:56:39Z',
 'fuel_type': 'diesel',
 'id': 'f90855a8-5853-5d95-a239-7d83c663eda1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE15667',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 142718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-02',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2015}
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE15667%27 HTTP/1.1" 200 None
2026-03-29 10:38:26 [auto1.de] INFO: Saving data for YE15667: {'auction_closing_time': 1774886199.0, 'created_time': 1774596944.495969, 'last_price_update_time': 1774780706.407864}
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YE15667') HTTP/1.1" 204 0
2026-03-29 10:38:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:26 [auto1.de] INFO: Found listing with ID: MF52928
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF52928%27 HTTP/1.1" 200 None
2026-03-29 10:38:26 [auto1.de] INFO: Scrape type for MF52928: 0
2026-03-29 10:38:26 [auto1.de] INFO: Found listing with ID: PG24864
2026-03-29 10:38:26 [auto1.de] INFO: Found listing with ID: VH75951
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH75951%27 HTTP/1.1" 200 None
2026-03-29 10:38:26 [auto1.de] INFO: Scrape type for VH75951: 0
2026-03-29 10:38:26 [auto1.de] INFO: Found listing with ID: NV16003
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV16003%27 HTTP/1.1" 200 None
2026-03-29 10:38:26 [auto1.de] INFO: Scrape type for NV16003: 0
2026-03-29 10:38:26 [auto1.de] INFO: Found listing with ID: XZ81913
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ81913%27 HTTP/1.1" 200 None
2026-03-29 10:38:26 [auto1.de] INFO: Scrape type for XZ81913: 0
2026-03-29 10:38:26 [auto1.de] INFO: Found listing with ID: EZ76409
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ76409%27 HTTP/1.1" 200 None
2026-03-29 10:38:26 [auto1.de] INFO: Scrape type for EZ76409: 0
2026-03-29 10:38:26 [auto1.de] INFO: Found listing with ID: BN05463
2026-03-29 10:38:26 [auto1.de] INFO: Found listing with ID: VJ41763
2026-03-29 10:38:26 [auto1.de] INFO: Found listing with ID: KE01132
2026-03-29 10:38:26 [auto1.de] INFO: Found listing with ID: FN00007
2026-03-29 10:38:26 [auto1.de] INFO: Found listing with ID: ZP35673
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP35673%27 HTTP/1.1" 200 None
2026-03-29 10:38:26 [auto1.de] INFO: Scrape type for ZP35673: 0
2026-03-29 10:38:26 [auto1.de] INFO: Found listing with ID: NZ97529
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ97529%27 HTTP/1.1" 200 None
2026-03-29 10:38:26 [auto1.de] INFO: Scrape type for NZ97529: 0
2026-03-29 10:38:26 [auto1.de] INFO: Found listing with ID: KU33020
2026-03-29 10:38:26 [auto1.de] INFO: Found listing with ID: LY63644
2026-03-29 10:38:26 [auto1.de] INFO: Found listing with ID: ES42650
2026-03-29 10:38:26 [auto1.de] INFO: Found listing with ID: DE98094
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE98094%27 HTTP/1.1" 200 None
2026-03-29 10:38:26 [auto1.de] INFO: Scrape type for DE98094: 0
2026-03-29 10:38:26 [auto1.de] INFO: Found listing with ID: UE61705
2026-03-29 10:38:26 [auto1.de] INFO: Found listing with ID: EJ47676
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ47676%27 HTTP/1.1" 200 None
2026-03-29 10:38:26 [auto1.de] INFO: Scrape type for EJ47676: 0
2026-03-29 10:38:26 [auto1.de] INFO: Found listing with ID: SC90935
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC90935%27 HTTP/1.1" 200 None
2026-03-29 10:38:26 [auto1.de] INFO: Scrape type for SC90935: 0
2026-03-29 10:38:26 [auto1.de] INFO: Found listing with ID: PR56411
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR56411%27 HTTP/1.1" 200 None
2026-03-29 10:38:26 [auto1.de] INFO: Scrape type for PR56411: 0
2026-03-29 10:38:26 [auto1.de] INFO: Found listing with ID: ZE90376
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE90376%27 HTTP/1.1" 200 None
2026-03-29 10:38:26 [auto1.de] INFO: Scrape type for ZE90376: 0
2026-03-29 10:38:26 [auto1.de] INFO: Found listing with ID: XR74072
2026-03-29 10:38:26 [auto1.de] INFO: Found listing with ID: LH20515
2026-03-29 10:38:26 [auto1.de] INFO: Found listing with ID: ED89448
2026-03-29 10:38:26 [auto1.de] INFO: Found listing with ID: SF00681
2026-03-29 10:38:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:27 [auto1.de] INFO: Channel: 24h | Page: 39 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: NK09609
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK09609%27 HTTP/1.1" 200 None
2026-03-29 10:38:27 [auto1.de] INFO: Scrape type for NK09609: 0
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: ZE41577
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: SA81936
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: JE00015
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: UL75790
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL75790%27 HTTP/1.1" 200 None
2026-03-29 10:38:27 [auto1.de] INFO: Scrape type for UL75790: 0
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: UM95943
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: ZS46633
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: JS64432
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: US49854
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US49854%27 HTTP/1.1" 200 None
2026-03-29 10:38:27 [auto1.de] INFO: Scrape type for US49854: 0
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: UD14847
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: BE14691
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE14691%27 HTTP/1.1" 200 None
2026-03-29 10:38:27 [auto1.de] INFO: Scrape type for BE14691: 0
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: NZ32972
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: FC97863
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC97863%27 HTTP/1.1" 200 None
2026-03-29 10:38:27 [auto1.de] INFO: Scrape type for FC97863: 0
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: MR34714
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR34714%27 HTTP/1.1" 200 None
2026-03-29 10:38:27 [auto1.de] INFO: Scrape type for MR34714: 0
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: CE15038
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE15038%27 HTTP/1.1" 200 None
2026-03-29 10:38:27 [auto1.de] INFO: Scrape type for CE15038: 0
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: ZB74366
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: KF39713
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: RG49246
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG49246%27 HTTP/1.1" 200 None
2026-03-29 10:38:27 [auto1.de] INFO: Scrape type for RG49246: 0
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: GY11970
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: XR26970
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: BD66077
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: SJ64041
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ64041%27 HTTP/1.1" 200 None
2026-03-29 10:38:27 [auto1.de] INFO: Scrape type for SJ64041: 0
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: AG64287
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: MY48468
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: LR49989
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR49989%27 HTTP/1.1" 200 None
2026-03-29 10:38:27 [auto1.de] INFO: Scrape type for LR49989: 0
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: VU33733
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: FK95510
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: MF75644
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: XT91998
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT91998%27 HTTP/1.1" 200 None
2026-03-29 10:38:27 [auto1.de] INFO: Scrape type for XT91998: 0
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: BF57036
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: ET94101
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET94101%27 HTTP/1.1" 200 None
2026-03-29 10:38:27 [auto1.de] INFO: Scrape type for ET94101: 0
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: BP39068
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP39068%27 HTTP/1.1" 200 None
2026-03-29 10:38:27 [auto1.de] INFO: Scrape type for BP39068: 0
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: WA46959
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA46959%27 HTTP/1.1" 200 None
2026-03-29 10:38:27 [auto1.de] INFO: Scrape type for WA46959: 0
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: BS37801
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: DL95738
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL95738%27 HTTP/1.1" 200 None
2026-03-29 10:38:27 [auto1.de] INFO: Scrape type for DL95738: 0
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: SZ97715
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ97715%27 HTTP/1.1" 200 None
2026-03-29 10:38:27 [auto1.de] INFO: Scrape type for SZ97715: 0
2026-03-29 10:38:27 [auto1.de] INFO: Found listing with ID: YV03143
2026-03-29 10:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV03143%27 HTTP/1.1" 200 None
2026-03-29 10:38:28 [auto1.de] INFO: Scrape type for YV03143: 0
2026-03-29 10:38:28 [auto1.de] INFO: Found listing with ID: BJ34801
2026-03-29 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ34801%27 HTTP/1.1" 200 None
2026-03-29 10:38:28 [auto1.de] INFO: Scrape type for BJ34801: 0
2026-03-29 10:38:28 [auto1.de] INFO: Found listing with ID: TU08005
2026-03-29 10:38:28 [auto1.de] INFO: Found listing with ID: VJ57746
2026-03-29 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ57746%27 HTTP/1.1" 200 None
2026-03-29 10:38:28 [auto1.de] INFO: Scrape type for VJ57746: 0
2026-03-29 10:38:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:29 [auto1.de] INFO: Channel: 24h | Page: 40 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:29 [auto1.de] INFO: Found listing with ID: GG93130
2026-03-29 10:38:29 [auto1.de] INFO: Found listing with ID: UC57196
2026-03-29 10:38:29 [auto1.de] INFO: Found listing with ID: NR35268
2026-03-29 10:38:29 [auto1.de] INFO: Found listing with ID: UC31654
2026-03-29 10:38:29 [auto1.de] INFO: Found listing with ID: BD51611
2026-03-29 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD51611%27 HTTP/1.1" 200 None
2026-03-29 10:38:29 [auto1.de] INFO: Scrape type for BD51611: 0
2026-03-29 10:38:29 [auto1.de] INFO: Found listing with ID: MK66887
2026-03-29 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK66887%27 HTTP/1.1" 200 None
2026-03-29 10:38:29 [auto1.de] INFO: Scrape type for MK66887: 2
2026-03-29 10:38:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f87ca8d-80ba-5bb0-b143-7df81e953605 with identifier: MK66887
2026-03-29 10:38:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f87ca8d-80ba-5bb0-b143-7df81e953605 with scrape type 2
2026-03-29 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f87ca8d-80ba-5bb0-b143-7df81e953605 with scrape type 2
2026-03-29 10:38:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f87ca8d-80ba-5bb0-b143-7df81e953605, identifier: MK66887
2026-03-29 10:38:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f87ca8d-80ba-5bb0-b143-7df81e953605 with identifier: MK66887
2026-03-29 10:38:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f87ca8d-80ba-5bb0-b143-7df81e953605 with identifier: MK66887
2026-03-29 10:38:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f87ca8d-80ba-5bb0-b143-7df81e953605 with identifier: MK66887 to the API
2026-03-29 10:38:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:38:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:38:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:20:59Z',
 'fuel_type': 'diesel',
 'id': '8f87ca8d-80ba-5bb0-b143-7df81e953605',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK66887',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 90326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-13',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 310 L2 Tourneo Titanium',
 'transmission': 'manual',
 'trim': '310 L2 Tourneo Titanium',
 'year': 2019}
2026-03-29 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK66887%27 HTTP/1.1" 200 None
2026-03-29 10:38:29 [auto1.de] INFO: Saving data for MK66887: {'auction_closing_time': 1774884059.0, 'created_time': 1774350168.445839, 'last_price_update_time': 1774780709.78783}
2026-03-29 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK66887') HTTP/1.1" 204 0
2026-03-29 10:38:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:29 [auto1.de] INFO: Found listing with ID: ML06015
2026-03-29 10:38:29 [auto1.de] INFO: Found listing with ID: VH61695
2026-03-29 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH61695%27 HTTP/1.1" 200 None
2026-03-29 10:38:29 [auto1.de] INFO: Scrape type for VH61695: 0
2026-03-29 10:38:29 [auto1.de] INFO: Found listing with ID: BG37163
2026-03-29 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG37163%27 HTTP/1.1" 200 None
2026-03-29 10:38:29 [auto1.de] INFO: Scrape type for BG37163: 0
2026-03-29 10:38:29 [auto1.de] INFO: Found listing with ID: AZ42176
2026-03-29 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ42176%27 HTTP/1.1" 200 None
2026-03-29 10:38:29 [auto1.de] INFO: Scrape type for AZ42176: 0
2026-03-29 10:38:29 [auto1.de] INFO: Found listing with ID: CD76809
2026-03-29 10:38:29 [auto1.de] INFO: Found listing with ID: YK98725
2026-03-29 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK98725%27 HTTP/1.1" 200 None
2026-03-29 10:38:29 [auto1.de] INFO: Scrape type for YK98725: 0
2026-03-29 10:38:29 [auto1.de] INFO: Found listing with ID: TV18739
2026-03-29 10:38:29 [auto1.de] INFO: Found listing with ID: NZ89642
2026-03-29 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ89642%27 HTTP/1.1" 200 None
2026-03-29 10:38:29 [auto1.de] INFO: Scrape type for NZ89642: 0
2026-03-29 10:38:29 [auto1.de] INFO: Found listing with ID: EE77460
2026-03-29 10:38:29 [auto1.de] INFO: Found listing with ID: JM79272
2026-03-29 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM79272%27 HTTP/1.1" 200 None
2026-03-29 10:38:29 [auto1.de] INFO: Scrape type for JM79272: 0
2026-03-29 10:38:29 [auto1.de] INFO: Found listing with ID: KF96010
2026-03-29 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF96010%27 HTTP/1.1" 200 None
2026-03-29 10:38:30 [auto1.de] INFO: Scrape type for KF96010: 0
2026-03-29 10:38:30 [auto1.de] INFO: Found listing with ID: KS26285
2026-03-29 10:38:30 [auto1.de] INFO: Found listing with ID: EG39650
2026-03-29 10:38:30 [auto1.de] INFO: Found listing with ID: GJ42738
2026-03-29 10:38:30 [auto1.de] INFO: Found listing with ID: XF55006
2026-03-29 10:38:30 [auto1.de] INFO: Found listing with ID: KH46132
2026-03-29 10:38:30 [auto1.de] INFO: Found listing with ID: AF88464
2026-03-29 10:38:30 [auto1.de] INFO: Found listing with ID: HA89104
2026-03-29 10:38:30 [auto1.de] INFO: Found listing with ID: UA99950
2026-03-29 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA99950%27 HTTP/1.1" 200 None
2026-03-29 10:38:30 [auto1.de] INFO: Scrape type for UA99950: 0
2026-03-29 10:38:30 [auto1.de] INFO: Found listing with ID: PP83297
2026-03-29 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP83297%27 HTTP/1.1" 200 None
2026-03-29 10:38:30 [auto1.de] INFO: Scrape type for PP83297: 0
2026-03-29 10:38:30 [auto1.de] INFO: Found listing with ID: DM27996
2026-03-29 10:38:30 [auto1.de] INFO: Found listing with ID: VT53198
2026-03-29 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT53198%27 HTTP/1.1" 200 None
2026-03-29 10:38:30 [auto1.de] INFO: Scrape type for VT53198: 0
2026-03-29 10:38:30 [auto1.de] INFO: Found listing with ID: EL92267
2026-03-29 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL92267%27 HTTP/1.1" 200 None
2026-03-29 10:38:30 [auto1.de] INFO: Scrape type for EL92267: 0
2026-03-29 10:38:30 [auto1.de] INFO: Found listing with ID: RK12981
2026-03-29 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK12981%27 HTTP/1.1" 200 None
2026-03-29 10:38:30 [auto1.de] INFO: Scrape type for RK12981: 0
2026-03-29 10:38:30 [auto1.de] INFO: Found listing with ID: AA46272
2026-03-29 10:38:30 [auto1.de] INFO: Found listing with ID: JN95479
2026-03-29 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN95479%27 HTTP/1.1" 200 None
2026-03-29 10:38:30 [auto1.de] INFO: Scrape type for JN95479: 0
2026-03-29 10:38:30 [auto1.de] INFO: Found listing with ID: ES37621
2026-03-29 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES37621%27 HTTP/1.1" 200 None
2026-03-29 10:38:30 [auto1.de] INFO: Scrape type for ES37621: 0
2026-03-29 10:38:30 [auto1.de] INFO: Found listing with ID: ZT53548
2026-03-29 10:38:30 [auto1.de] INFO: Found listing with ID: HC77687
2026-03-29 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC77687%27 HTTP/1.1" 200 None
2026-03-29 10:38:30 [auto1.de] INFO: Scrape type for HC77687: 0
2026-03-29 10:38:30 [auto1.de] INFO: Found listing with ID: FV67492
2026-03-29 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV67492%27 HTTP/1.1" 200 None
2026-03-29 10:38:30 [auto1.de] INFO: Scrape type for FV67492: 0
2026-03-29 10:38:30 [auto1.de] INFO: Found listing with ID: XG77480
2026-03-29 10:38:30 [auto1.de] INFO: Found listing with ID: AM78577
2026-03-29 10:38:30 [auto1.de] INFO: Found listing with ID: VC64340
2026-03-29 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC64340%27 HTTP/1.1" 200 None
2026-03-29 10:38:30 [auto1.de] INFO: Scrape type for VC64340: 0
2026-03-29 10:38:30 [auto1.de] INFO: Found listing with ID: FR92717
2026-03-29 10:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:31 [auto1.de] INFO: Channel: 24h | Page: 41 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: DT94754
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT94754%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for DT94754: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: RL19832
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: TX63688
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX63688%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for TX63688: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: FB02841
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: PW12132
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: MR65343
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR65343%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for MR65343: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: DB36710
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB36710%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for DB36710: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: NT04254
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: HK50070
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK50070%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for HK50070: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: SU14525
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU14525%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for SU14525: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: CD56647
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD56647%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for CD56647: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: CL62984
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: GV91786
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: KP48554
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP48554%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for KP48554: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: JV68921
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: AY74749
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY74749%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for AY74749: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: FP33840
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: FE12352
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: GH02109
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: JJ83769
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ83769%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for JJ83769: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: LM10122
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: CM74095
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: ZE40568
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: RZ99970
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ99970%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for RZ99970: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: DM07006
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM07006%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for DM07006: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: SD32112
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD32112%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for SD32112: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: AU35390
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU35390%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for AU35390: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: EA74334
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA74334%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for EA74334: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: VU50436
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: HR96195
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR96195%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for HR96195: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: HG45518
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: FC83292
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: YH59538
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH59538%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for YH59538: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: GN89832
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: UP66494
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: VH10355
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH10355%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for VH10355: 0
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: HB62696
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: RE17232
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: GJ82118
2026-03-29 10:38:31 [auto1.de] INFO: Found listing with ID: RA54991
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA54991%27 HTTP/1.1" 200 None
2026-03-29 10:38:31 [auto1.de] INFO: Scrape type for RA54991: 0
2026-03-29 10:38:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:32 [auto1.de] INFO: Channel: 24h | Page: 42 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: BF27156
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: KE52706
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: MJ60689
2026-03-29 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ60689%27 HTTP/1.1" 200 None
2026-03-29 10:38:32 [auto1.de] INFO: Scrape type for MJ60689: 0
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: FK87284
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: ED74506
2026-03-29 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED74506%27 HTTP/1.1" 200 None
2026-03-29 10:38:32 [auto1.de] INFO: Scrape type for ED74506: 0
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: DR38241
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: VX13516
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: YP61369
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: BP78735
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: DP29257
2026-03-29 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP29257%27 HTTP/1.1" 200 None
2026-03-29 10:38:32 [auto1.de] INFO: Scrape type for DP29257: 0
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: JN34969
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: XZ94866
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: KK19800
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: UJ12211
2026-03-29 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ12211%27 HTTP/1.1" 200 None
2026-03-29 10:38:32 [auto1.de] INFO: Scrape type for UJ12211: 0
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: DV91076
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: NC36065
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: ET79003
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: EW47494
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: WY09596
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: VL85665
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: PN64599
2026-03-29 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN64599%27 HTTP/1.1" 200 None
2026-03-29 10:38:32 [auto1.de] INFO: Scrape type for PN64599: 0
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: NP37775
2026-03-29 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP37775%27 HTTP/1.1" 200 None
2026-03-29 10:38:32 [auto1.de] INFO: Scrape type for NP37775: 0
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: CY44920
2026-03-29 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY44920%27 HTTP/1.1" 200 None
2026-03-29 10:38:32 [auto1.de] INFO: Scrape type for CY44920: 0
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: LM85706
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: NG80154
2026-03-29 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG80154%27 HTTP/1.1" 200 None
2026-03-29 10:38:32 [auto1.de] INFO: Scrape type for NG80154: 0
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: LA05422
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: UR14264
2026-03-29 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR14264%27 HTTP/1.1" 200 None
2026-03-29 10:38:32 [auto1.de] INFO: Scrape type for UR14264: 0
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: RF79085
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: KN80130
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: NM50493
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: KX50860
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: AC69838
2026-03-29 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC69838%27 HTTP/1.1" 200 None
2026-03-29 10:38:32 [auto1.de] INFO: Scrape type for AC69838: 0
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: BE25239
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: FT64336
2026-03-29 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT64336%27 HTTP/1.1" 200 None
2026-03-29 10:38:32 [auto1.de] INFO: Scrape type for FT64336: 0
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: VE16712
2026-03-29 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE16712%27 HTTP/1.1" 200 None
2026-03-29 10:38:32 [auto1.de] INFO: Scrape type for VE16712: 0
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: LK12001
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: JM07569
2026-03-29 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM07569%27 HTTP/1.1" 200 None
2026-03-29 10:38:32 [auto1.de] INFO: Scrape type for JM07569: 0
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: JG35367
2026-03-29 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35367%27 HTTP/1.1" 200 None
2026-03-29 10:38:32 [auto1.de] INFO: Scrape type for JG35367: 0
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: UR98494
2026-03-29 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR98494%27 HTTP/1.1" 200 None
2026-03-29 10:38:32 [auto1.de] INFO: Scrape type for UR98494: 0
2026-03-29 10:38:32 [auto1.de] INFO: Found listing with ID: GH47357
2026-03-29 10:38:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:33 [auto1.de] INFO: Channel: 24h | Page: 43 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: XJ52823
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ52823%27 HTTP/1.1" 200 None
2026-03-29 10:38:33 [auto1.de] INFO: Scrape type for XJ52823: 0
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: GU30537
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU30537%27 HTTP/1.1" 200 None
2026-03-29 10:38:33 [auto1.de] INFO: Scrape type for GU30537: 0
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: RU25678
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: CC57472
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC57472%27 HTTP/1.1" 200 None
2026-03-29 10:38:33 [auto1.de] INFO: Scrape type for CC57472: 0
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: YY13521
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY13521%27 HTTP/1.1" 200 None
2026-03-29 10:38:33 [auto1.de] INFO: Scrape type for YY13521: 0
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: GV09290
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: ZM88762
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: BU00695
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU00695%27 HTTP/1.1" 200 None
2026-03-29 10:38:33 [auto1.de] INFO: Scrape type for BU00695: 0
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: GH30720
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH30720%27 HTTP/1.1" 200 None
2026-03-29 10:38:33 [auto1.de] INFO: Scrape type for GH30720: 0
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: ER31380
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER31380%27 HTTP/1.1" 200 None
2026-03-29 10:38:33 [auto1.de] INFO: Scrape type for ER31380: 0
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: CJ94642
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ94642%27 HTTP/1.1" 200 None
2026-03-29 10:38:33 [auto1.de] INFO: Scrape type for CJ94642: 0
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: YS02767
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: WF16745
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF16745%27 HTTP/1.1" 200 None
2026-03-29 10:38:33 [auto1.de] INFO: Scrape type for WF16745: 0
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: KL90594
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: ZP86837
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP86837%27 HTTP/1.1" 200 None
2026-03-29 10:38:33 [auto1.de] INFO: Scrape type for ZP86837: 0
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: JZ68133
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: TL07964
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL07964%27 HTTP/1.1" 200 None
2026-03-29 10:38:33 [auto1.de] INFO: Scrape type for TL07964: 0
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: YW15548
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: SR15436
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR15436%27 HTTP/1.1" 200 None
2026-03-29 10:38:33 [auto1.de] INFO: Scrape type for SR15436: 0
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: KW12270
2026-03-29 10:38:33 [auto1.de] INFO: Found listing with ID: UC84662
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC84662%27 HTTP/1.1" 200 None
2026-03-29 10:38:34 [auto1.de] INFO: Scrape type for UC84662: 0
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: SW57264
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW57264%27 HTTP/1.1" 200 None
2026-03-29 10:38:34 [auto1.de] INFO: Scrape type for SW57264: 0
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: DF45808
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF45808%27 HTTP/1.1" 200 None
2026-03-29 10:38:34 [auto1.de] INFO: Scrape type for DF45808: 0
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: DX01657
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: CP43977
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: DT77440
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: PH27110
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH27110%27 HTTP/1.1" 200 None
2026-03-29 10:38:34 [auto1.de] INFO: Scrape type for PH27110: 0
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: LZ58710
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ58710%27 HTTP/1.1" 200 None
2026-03-29 10:38:34 [auto1.de] INFO: Scrape type for LZ58710: 0
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: FT91695
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT91695%27 HTTP/1.1" 200 None
2026-03-29 10:38:34 [auto1.de] INFO: Scrape type for FT91695: 0
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: VV46432
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV46432%27 HTTP/1.1" 200 None
2026-03-29 10:38:34 [auto1.de] INFO: Scrape type for VV46432: 0
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: DP90284
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: KM87247
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: SJ26339
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ26339%27 HTTP/1.1" 200 None
2026-03-29 10:38:34 [auto1.de] INFO: Scrape type for SJ26339: 0
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: ME45713
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: WK97473
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK97473%27 HTTP/1.1" 200 None
2026-03-29 10:38:34 [auto1.de] INFO: Scrape type for WK97473: 0
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: VG38985
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG38985%27 HTTP/1.1" 200 None
2026-03-29 10:38:34 [auto1.de] INFO: Scrape type for VG38985: 0
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: SN99491
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN99491%27 HTTP/1.1" 200 None
2026-03-29 10:38:34 [auto1.de] INFO: Scrape type for SN99491: 0
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: RM44288
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM44288%27 HTTP/1.1" 200 None
2026-03-29 10:38:34 [auto1.de] INFO: Scrape type for RM44288: 0
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: EG39576
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG39576%27 HTTP/1.1" 200 None
2026-03-29 10:38:34 [auto1.de] INFO: Scrape type for EG39576: 0
2026-03-29 10:38:34 [auto1.de] INFO: Found listing with ID: UZ90391
2026-03-29 10:38:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:35 [auto1.de] INFO: Channel: 24h | Page: 44 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:35 [auto1.de] INFO: Found listing with ID: KR04535
2026-03-29 10:38:35 [auto1.de] INFO: Found listing with ID: YN10477
2026-03-29 10:38:35 [auto1.de] INFO: Found listing with ID: RT10354
2026-03-29 10:38:35 [auto1.de] INFO: Found listing with ID: ZN20301
2026-03-29 10:38:35 [auto1.de] INFO: Found listing with ID: KV78740
2026-03-29 10:38:35 [auto1.de] INFO: Found listing with ID: FL12267
2026-03-29 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL12267%27 HTTP/1.1" 200 None
2026-03-29 10:38:35 [auto1.de] INFO: Scrape type for FL12267: 0
2026-03-29 10:38:35 [auto1.de] INFO: Found listing with ID: PY92753
2026-03-29 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY92753%27 HTTP/1.1" 200 None
2026-03-29 10:38:35 [auto1.de] INFO: Scrape type for PY92753: 0
2026-03-29 10:38:35 [auto1.de] INFO: Found listing with ID: WP28886
2026-03-29 10:38:35 [auto1.de] INFO: Found listing with ID: AB87355
2026-03-29 10:38:35 [auto1.de] INFO: Found listing with ID: RZ52630
2026-03-29 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ52630%27 HTTP/1.1" 200 None
2026-03-29 10:38:35 [auto1.de] INFO: Scrape type for RZ52630: 0
2026-03-29 10:38:35 [auto1.de] INFO: Found listing with ID: EC78476
2026-03-29 10:38:35 [auto1.de] INFO: Found listing with ID: LJ04369
2026-03-29 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ04369%27 HTTP/1.1" 200 None
2026-03-29 10:38:35 [auto1.de] INFO: Scrape type for LJ04369: 2
2026-03-29 10:38:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13ad8c3c-a8f7-5798-ab47-98d8cc46a6cd with identifier: LJ04369
2026-03-29 10:38:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13ad8c3c-a8f7-5798-ab47-98d8cc46a6cd with scrape type 2
2026-03-29 10:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13ad8c3c-a8f7-5798-ab47-98d8cc46a6cd with scrape type 2
2026-03-29 10:38:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13ad8c3c-a8f7-5798-ab47-98d8cc46a6cd, identifier: LJ04369
2026-03-29 10:38:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13ad8c3c-a8f7-5798-ab47-98d8cc46a6cd with identifier: LJ04369
2026-03-29 10:38:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13ad8c3c-a8f7-5798-ab47-98d8cc46a6cd with identifier: LJ04369
2026-03-29 10:38:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13ad8c3c-a8f7-5798-ab47-98d8cc46a6cd with identifier: LJ04369 to the API
2026-03-29 10:38:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:38:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:38:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:08:46Z',
 'fuel_type': 'diesel',
 'id': '13ad8c3c-a8f7-5798-ab47-98d8cc46a6cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ04369',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 240597,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-25',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Kombi EcoProfi',
 'transmission': 'manual',
 'trim': 'Kombi EcoProfi',
 'year': 2014}
2026-03-29 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ04369%27 HTTP/1.1" 200 None
2026-03-29 10:38:35 [auto1.de] INFO: Saving data for LJ04369: {'auction_closing_time': 1774883326.0, 'created_time': 1772729279.460841, 'last_price_update_time': 1774780715.998119}
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ04369') HTTP/1.1" 204 0
2026-03-29 10:38:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: SD72223
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD72223%27 HTTP/1.1" 200 None
2026-03-29 10:38:36 [auto1.de] INFO: Scrape type for SD72223: 0
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: ZD28576
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: FU53159
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU53159%27 HTTP/1.1" 200 None
2026-03-29 10:38:36 [auto1.de] INFO: Scrape type for FU53159: 0
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: BA95413
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: FB31140
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: XL62342
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: RE63795
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: DW76497
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW76497%27 HTTP/1.1" 200 None
2026-03-29 10:38:36 [auto1.de] INFO: Scrape type for DW76497: 0
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: JX37368
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX37368%27 HTTP/1.1" 200 None
2026-03-29 10:38:36 [auto1.de] INFO: Scrape type for JX37368: 0
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: WV94095
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: HU57590
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: MZ72792
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: HB06049
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: PD00543
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: BJ60837
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: VL06718
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: DU27539
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: YP91741
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP91741%27 HTTP/1.1" 200 None
2026-03-29 10:38:36 [auto1.de] INFO: Scrape type for YP91741: 0
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: BP81340
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP81340%27 HTTP/1.1" 200 None
2026-03-29 10:38:36 [auto1.de] INFO: Scrape type for BP81340: 0
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: LJ93781
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: DF63833
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF63833%27 HTTP/1.1" 200 None
2026-03-29 10:38:36 [auto1.de] INFO: Scrape type for DF63833: 0
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: FU39624
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU39624%27 HTTP/1.1" 200 None
2026-03-29 10:38:36 [auto1.de] INFO: Scrape type for FU39624: 0
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: RN03307
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: UR77035
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: MU50288
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU50288%27 HTTP/1.1" 200 None
2026-03-29 10:38:36 [auto1.de] INFO: Scrape type for MU50288: 0
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: UD59606
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD59606%27 HTTP/1.1" 200 None
2026-03-29 10:38:36 [auto1.de] INFO: Scrape type for UD59606: 0
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: SW83321
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW83321%27 HTTP/1.1" 200 None
2026-03-29 10:38:36 [auto1.de] INFO: Scrape type for SW83321: 0
2026-03-29 10:38:36 [auto1.de] INFO: Found listing with ID: EM22494
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM22494%27 HTTP/1.1" 200 None
2026-03-29 10:38:36 [auto1.de] INFO: Scrape type for EM22494: 0
2026-03-29 10:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:37 [auto1.de] INFO: Channel: 24h | Page: 45 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: PA37640
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA37640%27 HTTP/1.1" 200 None
2026-03-29 10:38:37 [auto1.de] INFO: Scrape type for PA37640: 0
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: MV18053
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV18053%27 HTTP/1.1" 200 None
2026-03-29 10:38:37 [auto1.de] INFO: Scrape type for MV18053: 0
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: NN66597
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: KA22944
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA22944%27 HTTP/1.1" 200 None
2026-03-29 10:38:37 [auto1.de] INFO: Scrape type for KA22944: 0
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: YN95759
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: JR17780
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: WY54008
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: PV27021
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV27021%27 HTTP/1.1" 200 None
2026-03-29 10:38:37 [auto1.de] INFO: Scrape type for PV27021: 0
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: AP27918
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP27918%27 HTTP/1.1" 200 None
2026-03-29 10:38:37 [auto1.de] INFO: Scrape type for AP27918: 0
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: EZ35619
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ35619%27 HTTP/1.1" 200 None
2026-03-29 10:38:37 [auto1.de] INFO: Scrape type for EZ35619: 0
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: PK38056
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK38056%27 HTTP/1.1" 200 None
2026-03-29 10:38:37 [auto1.de] INFO: Scrape type for PK38056: 0
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: VG14564
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: HB13325
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: HB67029
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB67029%27 HTTP/1.1" 200 None
2026-03-29 10:38:37 [auto1.de] INFO: Scrape type for HB67029: 0
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: FU04810
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: GM08795
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM08795%27 HTTP/1.1" 200 None
2026-03-29 10:38:37 [auto1.de] INFO: Scrape type for GM08795: 0
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: GV91046
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: ED00109
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: LR95574
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR95574%27 HTTP/1.1" 200 None
2026-03-29 10:38:37 [auto1.de] INFO: Scrape type for LR95574: 0
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: RZ48384
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: SB60272
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: FG07323
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: GA42145
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: NZ25875
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ25875%27 HTTP/1.1" 200 None
2026-03-29 10:38:37 [auto1.de] INFO: Scrape type for NZ25875: 0
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: TN32015
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: XY68410
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: YU93919
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU93919%27 HTTP/1.1" 200 None
2026-03-29 10:38:37 [auto1.de] INFO: Scrape type for YU93919: 0
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: LG85121
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG85121%27 HTTP/1.1" 200 None
2026-03-29 10:38:37 [auto1.de] INFO: Scrape type for LG85121: 0
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: YR11157
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR11157%27 HTTP/1.1" 200 None
2026-03-29 10:38:37 [auto1.de] INFO: Scrape type for YR11157: 0
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: XB39806
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB39806%27 HTTP/1.1" 200 None
2026-03-29 10:38:37 [auto1.de] INFO: Scrape type for XB39806: 0
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: TE25882
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE25882%27 HTTP/1.1" 200 None
2026-03-29 10:38:37 [auto1.de] INFO: Scrape type for TE25882: 0
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: DA23811
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: DZ79939
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: TD17986
2026-03-29 10:38:37 [auto1.de] INFO: Found listing with ID: LR74805
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR74805%27 HTTP/1.1" 200 None
2026-03-29 10:38:37 [auto1.de] INFO: Scrape type for LR74805: 2
2026-03-29 10:38:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d14e9819-60ba-5540-9ddb-f0b81d50936c with identifier: LR74805
2026-03-29 10:38:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d14e9819-60ba-5540-9ddb-f0b81d50936c with scrape type 2
2026-03-29 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d14e9819-60ba-5540-9ddb-f0b81d50936c with scrape type 2
2026-03-29 10:38:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d14e9819-60ba-5540-9ddb-f0b81d50936c, identifier: LR74805
2026-03-29 10:38:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d14e9819-60ba-5540-9ddb-f0b81d50936c with identifier: LR74805
2026-03-29 10:38:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d14e9819-60ba-5540-9ddb-f0b81d50936c with identifier: LR74805
2026-03-29 10:38:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d14e9819-60ba-5540-9ddb-f0b81d50936c with identifier: LR74805 to the API
2026-03-29 10:38:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:38:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 188,
 'expiration_date': '2026-03-30T15:41:42Z',
 'fuel_type': 'hybrid',
 'id': 'd14e9819-60ba-5540-9ddb-f0b81d50936c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR74805',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Eclipse Cross',
 'odometer': 7099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-27',
 'seller_name': None,
 'title': 'Mitsubishi Eclipse Cross 2.4 Plug-in Hybrid 4WD',
 'transmission': 'automatic',
 'trim': '4WD',
 'year': 2022}
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR74805%27 HTTP/1.1" 200 None
2026-03-29 10:38:38 [auto1.de] INFO: Saving data for LR74805: {'auction_closing_time': 1774885302.0, 'created_time': 1774350483.716935, 'last_price_update_time': 1774780718.144409}
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR74805') HTTP/1.1" 204 0
2026-03-29 10:38:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: AS21942
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: MX03618
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX03618%27 HTTP/1.1" 200 None
2026-03-29 10:38:38 [auto1.de] INFO: Scrape type for MX03618: 0
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: XS38036
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: DC30039
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC30039%27 HTTP/1.1" 200 None
2026-03-29 10:38:38 [auto1.de] INFO: Scrape type for DC30039: 0
2026-03-29 10:38:38 [auto1.de] INFO: Found listing with ID: RV99753
2026-03-29 10:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:39 [auto1.de] INFO: Channel: 24h | Page: 46 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: JS29851
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS29851%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for JS29851: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: MP20467
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP20467%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for MP20467: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: MB94614
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: UK63954
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK63954%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for UK63954: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: VM82441
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM82441%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for VM82441: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: DT00101
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: CF62011
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF62011%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for CF62011: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: WF80406
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF80406%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for WF80406: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: HS55483
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: KC92334
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC92334%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for KC92334: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: FK07510
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK07510%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for FK07510: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: VP02166
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: CR26855
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: BR02307
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: DF30572
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: SV15826
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV15826%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for SV15826: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: PJ17742
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: FK97856
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: RS09713
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: RB89503
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: ST87748
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST87748%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for ST87748: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: EY26571
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY26571%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for EY26571: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: JN99222
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: HE35464
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: GH93549
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: WP86079
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP86079%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for WP86079: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: LN30435
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN30435%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for LN30435: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: DF02739
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: DL97595
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL97595%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for DL97595: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: CL06528
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: VE57105
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE57105%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for VE57105: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: VK94352
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: CC99000
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC99000%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for CC99000: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: UB25361
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB25361%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for UB25361: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: YS81277
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: TN63570
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN63570%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for TN63570: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: PX08843
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX08843%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for PX08843: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: CB12842
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB12842%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for CB12842: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: FH53485
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH53485%27 HTTP/1.1" 200 None
2026-03-29 10:38:39 [auto1.de] INFO: Scrape type for FH53485: 0
2026-03-29 10:38:39 [auto1.de] INFO: Found listing with ID: UC38867
2026-03-29 10:38:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:40 [auto1.de] INFO: Channel: 24h | Page: 47 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:40 [auto1.de] INFO: Found listing with ID: UG93766
2026-03-29 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG93766%27 HTTP/1.1" 200 None
2026-03-29 10:38:40 [auto1.de] INFO: Scrape type for UG93766: 0
2026-03-29 10:38:40 [auto1.de] INFO: Found listing with ID: HH61225
2026-03-29 10:38:40 [auto1.de] INFO: Found listing with ID: AL34551
2026-03-29 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL34551%27 HTTP/1.1" 200 None
2026-03-29 10:38:40 [auto1.de] INFO: Scrape type for AL34551: 0
2026-03-29 10:38:40 [auto1.de] INFO: Found listing with ID: VF83806
2026-03-29 10:38:40 [auto1.de] INFO: Found listing with ID: DL95499
2026-03-29 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL95499%27 HTTP/1.1" 200 None
2026-03-29 10:38:40 [auto1.de] INFO: Scrape type for DL95499: 0
2026-03-29 10:38:40 [auto1.de] INFO: Found listing with ID: JB33429
2026-03-29 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB33429%27 HTTP/1.1" 200 None
2026-03-29 10:38:40 [auto1.de] INFO: Scrape type for JB33429: 0
2026-03-29 10:38:40 [auto1.de] INFO: Found listing with ID: CK59033
2026-03-29 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK59033%27 HTTP/1.1" 200 None
2026-03-29 10:38:40 [auto1.de] INFO: Scrape type for CK59033: 0
2026-03-29 10:38:40 [auto1.de] INFO: Found listing with ID: TG33672
2026-03-29 10:38:40 [auto1.de] INFO: Found listing with ID: NR64586
2026-03-29 10:38:40 [auto1.de] INFO: Found listing with ID: DT42363
2026-03-29 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT42363%27 HTTP/1.1" 200 None
2026-03-29 10:38:40 [auto1.de] INFO: Scrape type for DT42363: 0
2026-03-29 10:38:40 [auto1.de] INFO: Found listing with ID: GE96921
2026-03-29 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE96921%27 HTTP/1.1" 200 None
2026-03-29 10:38:40 [auto1.de] INFO: Scrape type for GE96921: 0
2026-03-29 10:38:40 [auto1.de] INFO: Found listing with ID: FW30112
2026-03-29 10:38:40 [auto1.de] INFO: Found listing with ID: GC11605
2026-03-29 10:38:40 [auto1.de] INFO: Found listing with ID: JW75116
2026-03-29 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW75116%27 HTTP/1.1" 200 None
2026-03-29 10:38:40 [auto1.de] INFO: Scrape type for JW75116: 0
2026-03-29 10:38:40 [auto1.de] INFO: Found listing with ID: FM53272
2026-03-29 10:38:40 [auto1.de] INFO: Found listing with ID: UL70410
2026-03-29 10:38:40 [auto1.de] INFO: Found listing with ID: DM95893
2026-03-29 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM95893%27 HTTP/1.1" 200 None
2026-03-29 10:38:40 [auto1.de] INFO: Scrape type for DM95893: 0
2026-03-29 10:38:40 [auto1.de] INFO: Found listing with ID: UN96808
2026-03-29 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN96808%27 HTTP/1.1" 200 None
2026-03-29 10:38:40 [auto1.de] INFO: Scrape type for UN96808: 0
2026-03-29 10:38:40 [auto1.de] INFO: Found listing with ID: DW78199
2026-03-29 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW78199%27 HTTP/1.1" 200 None
2026-03-29 10:38:40 [auto1.de] INFO: Scrape type for DW78199: 0
2026-03-29 10:38:40 [auto1.de] INFO: Found listing with ID: HB72145
2026-03-29 10:38:40 [auto1.de] INFO: Found listing with ID: JS73501
2026-03-29 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS73501%27 HTTP/1.1" 200 None
2026-03-29 10:38:41 [auto1.de] INFO: Scrape type for JS73501: 0
2026-03-29 10:38:41 [auto1.de] INFO: Found listing with ID: GE16553
2026-03-29 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE16553%27 HTTP/1.1" 200 None
2026-03-29 10:38:41 [auto1.de] INFO: Scrape type for GE16553: 0
2026-03-29 10:38:41 [auto1.de] INFO: Found listing with ID: DE41778
2026-03-29 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE41778%27 HTTP/1.1" 200 None
2026-03-29 10:38:41 [auto1.de] INFO: Scrape type for DE41778: 0
2026-03-29 10:38:41 [auto1.de] INFO: Found listing with ID: UL41666
2026-03-29 10:38:41 [auto1.de] INFO: Found listing with ID: GB33155
2026-03-29 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB33155%27 HTTP/1.1" 200 None
2026-03-29 10:38:41 [auto1.de] INFO: Scrape type for GB33155: 0
2026-03-29 10:38:41 [auto1.de] INFO: Found listing with ID: EB33579
2026-03-29 10:38:41 [auto1.de] INFO: Found listing with ID: RL23601
2026-03-29 10:38:41 [auto1.de] INFO: Found listing with ID: UZ81937
2026-03-29 10:38:41 [auto1.de] INFO: Found listing with ID: AZ05535
2026-03-29 10:38:41 [auto1.de] INFO: Found listing with ID: DW36097
2026-03-29 10:38:41 [auto1.de] INFO: Found listing with ID: AU85949
2026-03-29 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU85949%27 HTTP/1.1" 200 None
2026-03-29 10:38:41 [auto1.de] INFO: Scrape type for AU85949: 0
2026-03-29 10:38:41 [auto1.de] INFO: Found listing with ID: SP97012
2026-03-29 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP97012%27 HTTP/1.1" 200 None
2026-03-29 10:38:41 [auto1.de] INFO: Scrape type for SP97012: 0
2026-03-29 10:38:41 [auto1.de] INFO: Found listing with ID: MA42451
2026-03-29 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA42451%27 HTTP/1.1" 200 None
2026-03-29 10:38:41 [auto1.de] INFO: Scrape type for MA42451: 0
2026-03-29 10:38:41 [auto1.de] INFO: Found listing with ID: MC22222
2026-03-29 10:38:41 [auto1.de] INFO: Found listing with ID: EL90308
2026-03-29 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL90308%27 HTTP/1.1" 200 None
2026-03-29 10:38:41 [auto1.de] INFO: Scrape type for EL90308: 0
2026-03-29 10:38:41 [auto1.de] INFO: Found listing with ID: UB34830
2026-03-29 10:38:41 [auto1.de] INFO: Found listing with ID: YF48046
2026-03-29 10:38:41 [auto1.de] INFO: Found listing with ID: ZR08367
2026-03-29 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR08367%27 HTTP/1.1" 200 None
2026-03-29 10:38:41 [auto1.de] INFO: Scrape type for ZR08367: 0
2026-03-29 10:38:41 [auto1.de] INFO: Found listing with ID: MR96643
2026-03-29 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR96643%27 HTTP/1.1" 200 None
2026-03-29 10:38:41 [auto1.de] INFO: Scrape type for MR96643: 0
2026-03-29 10:38:41 [auto1.de] INFO: Found listing with ID: FH94786
2026-03-29 10:38:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:42 [auto1.de] INFO: Channel: 24h | Page: 48 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: DH13363
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: KV57112
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV57112%27 HTTP/1.1" 200 None
2026-03-29 10:38:42 [auto1.de] INFO: Scrape type for KV57112: 0
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: KX26949
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: RN18911
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: CH56246
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH56246%27 HTTP/1.1" 200 None
2026-03-29 10:38:42 [auto1.de] INFO: Scrape type for CH56246: 0
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: GC04938
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC04938%27 HTTP/1.1" 200 None
2026-03-29 10:38:42 [auto1.de] INFO: Scrape type for GC04938: 0
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: VK31305
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK31305%27 HTTP/1.1" 200 None
2026-03-29 10:38:42 [auto1.de] INFO: Scrape type for VK31305: 0
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: VW82123
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: WJ71458
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ71458%27 HTTP/1.1" 200 None
2026-03-29 10:38:42 [auto1.de] INFO: Scrape type for WJ71458: 0
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: SX77194
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX77194%27 HTTP/1.1" 200 None
2026-03-29 10:38:42 [auto1.de] INFO: Scrape type for SX77194: 0
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: XZ35475
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ35475%27 HTTP/1.1" 200 None
2026-03-29 10:38:42 [auto1.de] INFO: Scrape type for XZ35475: 0
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: JJ95706
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: DD89889
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: CT74985
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: XU52502
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU52502%27 HTTP/1.1" 200 None
2026-03-29 10:38:42 [auto1.de] INFO: Scrape type for XU52502: 0
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: UH40808
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH40808%27 HTTP/1.1" 200 None
2026-03-29 10:38:42 [auto1.de] INFO: Scrape type for UH40808: 0
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: CS76015
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS76015%27 HTTP/1.1" 200 None
2026-03-29 10:38:42 [auto1.de] INFO: Scrape type for CS76015: 0
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: UA36533
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: AX51342
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: YJ51408
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ51408%27 HTTP/1.1" 200 None
2026-03-29 10:38:42 [auto1.de] INFO: Scrape type for YJ51408: 0
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: YJ71992
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: SG56142
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: XN70423
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: TB82704
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: JC56914
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: VG55778
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: PA09921
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: LD21016
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: EX27277
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX27277%27 HTTP/1.1" 200 None
2026-03-29 10:38:42 [auto1.de] INFO: Scrape type for EX27277: 0
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: AD73380
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: UA25868
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA25868%27 HTTP/1.1" 200 None
2026-03-29 10:38:42 [auto1.de] INFO: Scrape type for UA25868: 0
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: MZ60723
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ60723%27 HTTP/1.1" 200 None
2026-03-29 10:38:42 [auto1.de] INFO: Scrape type for MZ60723: 0
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: VX50427
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX50427%27 HTTP/1.1" 200 None
2026-03-29 10:38:42 [auto1.de] INFO: Scrape type for VX50427: 0
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: EJ57142
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: GB19657
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB19657%27 HTTP/1.1" 200 None
2026-03-29 10:38:42 [auto1.de] INFO: Scrape type for GB19657: 0
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: JJ39643
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ39643%27 HTTP/1.1" 200 None
2026-03-29 10:38:42 [auto1.de] INFO: Scrape type for JJ39643: 0
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: ZC19539
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: FG50189
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: WB12349
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB12349%27 HTTP/1.1" 200 None
2026-03-29 10:38:42 [auto1.de] INFO: Scrape type for WB12349: 0
2026-03-29 10:38:42 [auto1.de] INFO: Found listing with ID: KL38868
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL38868%27 HTTP/1.1" 200 None
2026-03-29 10:38:42 [auto1.de] INFO: Scrape type for KL38868: 0
2026-03-29 10:38:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:43 [auto1.de] INFO: Channel: 24h | Page: 49 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: ZA19141
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: BJ31953
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ31953%27 HTTP/1.1" 200 None
2026-03-29 10:38:43 [auto1.de] INFO: Scrape type for BJ31953: 0
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: BU60385
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: MK35059
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: DF93652
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF93652%27 HTTP/1.1" 200 None
2026-03-29 10:38:43 [auto1.de] INFO: Scrape type for DF93652: 0
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: DB09023
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB09023%27 HTTP/1.1" 200 None
2026-03-29 10:38:43 [auto1.de] INFO: Scrape type for DB09023: 0
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: PY88606
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: WJ04835
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: VM51620
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: EA67695
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: GP15297
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: MA41049
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: BU16541
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: TX40951
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: AV25336
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: ER78775
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: BG86685
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: EC81606
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC81606%27 HTTP/1.1" 200 None
2026-03-29 10:38:43 [auto1.de] INFO: Scrape type for EC81606: 0
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: LT09542
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: TM25044
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: LA66980
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: TL76772
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL76772%27 HTTP/1.1" 200 None
2026-03-29 10:38:43 [auto1.de] INFO: Scrape type for TL76772: 0
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: ZN73895
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN73895%27 HTTP/1.1" 200 None
2026-03-29 10:38:43 [auto1.de] INFO: Scrape type for ZN73895: 0
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: ZW55395
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: WA89012
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA89012%27 HTTP/1.1" 200 None
2026-03-29 10:38:43 [auto1.de] INFO: Scrape type for WA89012: 0
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: MW91844
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW91844%27 HTTP/1.1" 200 None
2026-03-29 10:38:43 [auto1.de] INFO: Scrape type for MW91844: 0
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: VY61993
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: XX63179
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX63179%27 HTTP/1.1" 200 None
2026-03-29 10:38:43 [auto1.de] INFO: Scrape type for XX63179: 0
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: VA54301
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA54301%27 HTTP/1.1" 200 None
2026-03-29 10:38:43 [auto1.de] INFO: Scrape type for VA54301: 0
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: HY47852
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY47852%27 HTTP/1.1" 200 None
2026-03-29 10:38:43 [auto1.de] INFO: Scrape type for HY47852: 0
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: SM09271
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM09271%27 HTTP/1.1" 200 None
2026-03-29 10:38:43 [auto1.de] INFO: Scrape type for SM09271: 0
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: DX42832
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX42832%27 HTTP/1.1" 200 None
2026-03-29 10:38:43 [auto1.de] INFO: Scrape type for DX42832: 0
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: MU33695
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: SY34106
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY34106%27 HTTP/1.1" 200 None
2026-03-29 10:38:43 [auto1.de] INFO: Scrape type for SY34106: 0
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: LV04533
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: HJ54097
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: ND90067
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND90067%27 HTTP/1.1" 200 None
2026-03-29 10:38:43 [auto1.de] INFO: Scrape type for ND90067: 0
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: HA10430
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: RY91957
2026-03-29 10:38:43 [auto1.de] INFO: Found listing with ID: MF56816
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF56816%27 HTTP/1.1" 200 None
2026-03-29 10:38:43 [auto1.de] INFO: Scrape type for MF56816: 0
2026-03-29 10:38:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:45 [auto1.de] INFO: Channel: 24h | Page: 50 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: CK72953
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK72953%27 HTTP/1.1" 200 None
2026-03-29 10:38:45 [auto1.de] INFO: Scrape type for CK72953: 0
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: KG08192
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: DX24804
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: PY46067
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY46067%27 HTTP/1.1" 200 None
2026-03-29 10:38:45 [auto1.de] INFO: Scrape type for PY46067: 0
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: GY23917
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY23917%27 HTTP/1.1" 200 None
2026-03-29 10:38:45 [auto1.de] INFO: Scrape type for GY23917: 0
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: WB03477
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB03477%27 HTTP/1.1" 200 None
2026-03-29 10:38:45 [auto1.de] INFO: Scrape type for WB03477: 0
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: GL07101
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: YM55237
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM55237%27 HTTP/1.1" 200 None
2026-03-29 10:38:45 [auto1.de] INFO: Scrape type for YM55237: 0
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: NC43616
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC43616%27 HTTP/1.1" 200 None
2026-03-29 10:38:45 [auto1.de] INFO: Scrape type for NC43616: 0
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: TE32041
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: NL36228
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL36228%27 HTTP/1.1" 200 None
2026-03-29 10:38:45 [auto1.de] INFO: Scrape type for NL36228: 0
2026-03-29 10:38:45 [auto1.de] INFO: Found listing with ID: SG58590
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG58590%27 HTTP/1.1" 200 None
2026-03-29 10:38:45 [auto1.de] INFO: Scrape type for SG58590: 2
2026-03-29 10:38:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edcce00f-bd6f-5ef0-a0e2-fada08e566da with identifier: SG58590
2026-03-29 10:38:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edcce00f-bd6f-5ef0-a0e2-fada08e566da with scrape type 2
2026-03-29 10:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item edcce00f-bd6f-5ef0-a0e2-fada08e566da with scrape type 2
2026-03-29 10:38:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: edcce00f-bd6f-5ef0-a0e2-fada08e566da, identifier: SG58590
2026-03-29 10:38:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: edcce00f-bd6f-5ef0-a0e2-fada08e566da with identifier: SG58590
2026-03-29 10:38:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: edcce00f-bd6f-5ef0-a0e2-fada08e566da with identifier: SG58590
2026-03-29 10:38:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: edcce00f-bd6f-5ef0-a0e2-fada08e566da with identifier: SG58590 to the API
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:38:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:38:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:25:51Z',
 'fuel_type': 'petrol',
 'id': 'edcce00f-bd6f-5ef0-a0e2-fada08e566da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG58590',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 122982,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-30',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Edition Dynamique',
 'transmission': 'manual',
 'trim': 'Edition Dynamique',
 'year': 2008}
2026-03-29 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG58590%27 HTTP/1.1" 200 None
2026-03-29 10:38:46 [auto1.de] INFO: Saving data for SG58590: {'auction_closing_time': 1774884351.0, 'created_time': 1774596942.975142, 'last_price_update_time': 1774780726.160924}
2026-03-29 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG58590') HTTP/1.1" 204 0
2026-03-29 10:38:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:46 [auto1.de] INFO: Found listing with ID: HX34455
2026-03-29 10:38:46 [auto1.de] INFO: Found listing with ID: YG72803
2026-03-29 10:38:46 [auto1.de] INFO: Found listing with ID: SM09769
2026-03-29 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM09769%27 HTTP/1.1" 200 None
2026-03-29 10:38:46 [auto1.de] INFO: Scrape type for SM09769: 0
2026-03-29 10:38:46 [auto1.de] INFO: Found listing with ID: HX00306
2026-03-29 10:38:46 [auto1.de] INFO: Found listing with ID: SA11985
2026-03-29 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA11985%27 HTTP/1.1" 200 None
2026-03-29 10:38:46 [auto1.de] INFO: Scrape type for SA11985: 0
2026-03-29 10:38:46 [auto1.de] INFO: Found listing with ID: AR62221
2026-03-29 10:38:46 [auto1.de] INFO: Found listing with ID: RA44966
2026-03-29 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA44966%27 HTTP/1.1" 200 None
2026-03-29 10:38:46 [auto1.de] INFO: Scrape type for RA44966: 0
2026-03-29 10:38:46 [auto1.de] INFO: Found listing with ID: NU23717
2026-03-29 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU23717%27 HTTP/1.1" 200 None
2026-03-29 10:38:46 [auto1.de] INFO: Scrape type for NU23717: 0
2026-03-29 10:38:46 [auto1.de] INFO: Found listing with ID: CY90259
2026-03-29 10:38:46 [auto1.de] INFO: Found listing with ID: ML64265
2026-03-29 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML64265%27 HTTP/1.1" 200 None
2026-03-29 10:38:46 [auto1.de] INFO: Scrape type for ML64265: 0
2026-03-29 10:38:46 [auto1.de] INFO: Found listing with ID: BY14877
2026-03-29 10:38:46 [auto1.de] INFO: Found listing with ID: AV93240
2026-03-29 10:38:46 [auto1.de] INFO: Found listing with ID: HB95489
2026-03-29 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB95489%27 HTTP/1.1" 200 None
2026-03-29 10:38:46 [auto1.de] INFO: Scrape type for HB95489: 0
2026-03-29 10:38:46 [auto1.de] INFO: Found listing with ID: RT79554
2026-03-29 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT79554%27 HTTP/1.1" 200 None
2026-03-29 10:38:46 [auto1.de] INFO: Scrape type for RT79554: 0
2026-03-29 10:38:46 [auto1.de] INFO: Found listing with ID: BZ09697
2026-03-29 10:38:46 [auto1.de] INFO: Found listing with ID: ZU18943
2026-03-29 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU18943%27 HTTP/1.1" 200 None
2026-03-29 10:38:46 [auto1.de] INFO: Scrape type for ZU18943: 0
2026-03-29 10:38:46 [auto1.de] INFO: Found listing with ID: GC82813
2026-03-29 10:38:46 [auto1.de] INFO: Found listing with ID: PL23541
2026-03-29 10:38:46 [auto1.de] INFO: Found listing with ID: JJ68009
2026-03-29 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ68009%27 HTTP/1.1" 200 None
2026-03-29 10:38:46 [auto1.de] INFO: Scrape type for JJ68009: 0
2026-03-29 10:38:46 [auto1.de] INFO: Found listing with ID: ND33880
2026-03-29 10:38:46 [auto1.de] INFO: Found listing with ID: GE28071
2026-03-29 10:38:46 [auto1.de] INFO: Found listing with ID: AB26225
2026-03-29 10:38:46 [auto1.de] INFO: Found listing with ID: FX62858
2026-03-29 10:38:46 [auto1.de] INFO: Found listing with ID: SC70285
2026-03-29 10:38:46 [auto1.de] INFO: Found listing with ID: CR61198
2026-03-29 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR61198%27 HTTP/1.1" 200 None
2026-03-29 10:38:46 [auto1.de] INFO: Scrape type for CR61198: 0
2026-03-29 10:38:46 [auto1.de] INFO: Found listing with ID: XB46016
2026-03-29 10:38:46 [auto1.de] INFO: Found listing with ID: BX34768
2026-03-29 10:38:46 [auto1.de] INFO: Found listing with ID: ZP61360
2026-03-29 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP61360%27 HTTP/1.1" 200 None
2026-03-29 10:38:46 [auto1.de] INFO: Scrape type for ZP61360: 0
2026-03-29 10:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:47 [auto1.de] INFO: Channel: 24h | Page: 51 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: CF74386
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: TV47355
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV47355%27 HTTP/1.1" 200 None
2026-03-29 10:38:47 [auto1.de] INFO: Scrape type for TV47355: 0
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: UZ04747
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ04747%27 HTTP/1.1" 200 None
2026-03-29 10:38:47 [auto1.de] INFO: Scrape type for UZ04747: 0
2026-03-29 10:38:47 [auto1.de] INFO: Found listing with ID: PB41592
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB41592%27 HTTP/1.1" 200 None
2026-03-29 10:38:47 [auto1.de] INFO: Scrape type for PB41592: 2
2026-03-29 10:38:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ed57afd-3f01-5e0a-9fda-06fb012db77c with identifier: PB41592
2026-03-29 10:38:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ed57afd-3f01-5e0a-9fda-06fb012db77c with scrape type 2
2026-03-29 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ed57afd-3f01-5e0a-9fda-06fb012db77c with scrape type 2
2026-03-29 10:38:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ed57afd-3f01-5e0a-9fda-06fb012db77c, identifier: PB41592
2026-03-29 10:38:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ed57afd-3f01-5e0a-9fda-06fb012db77c with identifier: PB41592
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 10:38:47 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-29 10:38:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 10:38:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ed57afd-3f01-5e0a-9fda-06fb012db77c with identifier: PB41592
2026-03-29 10:38:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ed57afd-3f01-5e0a-9fda-06fb012db77c with identifier: PB41592 to the API
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:38:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 360,
 'expiration_date': '2026-03-30T15:43:56Z',
 'fuel_type': 'electro',
 'id': '4ed57afd-3f01-5e0a-9fda-06fb012db77c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB41592',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'e-tron',
 'odometer': 26701,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-22',
 'seller_name': None,
 'title': 'Audi e-tron 55 quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2022}
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB41592%27 HTTP/1.1" 200 None
2026-03-29 10:38:48 [auto1.de] INFO: Saving data for PB41592: {'auction_closing_time': 1774885436.0, 'created_time': 1772726678.702162, 'last_price_update_time': 1774780728.577233}
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB41592') HTTP/1.1" 204 0
2026-03-29 10:38:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: CG17958
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: EH96711
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH96711%27 HTTP/1.1" 200 None
2026-03-29 10:38:48 [auto1.de] INFO: Scrape type for EH96711: 0
2026-03-29 10:38:48 [auto1.de] INFO: Found listing with ID: XL56937
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL56937%27 HTTP/1.1" 200 None
2026-03-29 10:38:48 [auto1.de] INFO: Scrape type for XL56937: 2
2026-03-29 10:38:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edc9cb10-babd-5e17-97f1-7965df10c168 with identifier: XL56937
2026-03-29 10:38:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edc9cb10-babd-5e17-97f1-7965df10c168 with scrape type 2
2026-03-29 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item edc9cb10-babd-5e17-97f1-7965df10c168 with scrape type 2
2026-03-29 10:38:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: edc9cb10-babd-5e17-97f1-7965df10c168, identifier: XL56937
2026-03-29 10:38:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: edc9cb10-babd-5e17-97f1-7965df10c168 with identifier: XL56937
2026-03-29 10:38:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: edc9cb10-babd-5e17-97f1-7965df10c168 with identifier: XL56937
2026-03-29 10:38:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: edc9cb10-babd-5e17-97f1-7965df10c168 with identifier: XL56937 to the API
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:38:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:31:43Z',
 'fuel_type': 'petrol',
 'id': 'edc9cb10-babd-5e17-97f1-7965df10c168',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL56937',
 'listing': 'auction',
 'make': 'Kia',
 'model': "pro_cee'd",
 'odometer': 59367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-17',
 'seller_name': None,
 'title': "Kia pro_cee'd 1.6 TGDI GT",
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2023}
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL56937%27 HTTP/1.1" 200 None
2026-03-29 10:38:49 [auto1.de] INFO: Saving data for XL56937: {'auction_closing_time': 1774884703.0, 'created_time': 1773946537.606522, 'last_price_update_time': 1774780729.308903}
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL56937') HTTP/1.1" 204 0
2026-03-29 10:38:49 [auto1.de] INFO: Found listing with ID: FG09102
2026-03-29 10:38:49 [auto1.de] INFO: Found listing with ID: YF25460
2026-03-29 10:38:49 [auto1.de] INFO: Found listing with ID: BN55276
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN55276%27 HTTP/1.1" 200 None
2026-03-29 10:38:49 [auto1.de] INFO: Scrape type for BN55276: 0
2026-03-29 10:38:49 [auto1.de] INFO: Found listing with ID: DE62797
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE62797%27 HTTP/1.1" 200 None
2026-03-29 10:38:49 [auto1.de] INFO: Scrape type for DE62797: 0
2026-03-29 10:38:49 [auto1.de] INFO: Found listing with ID: KE90255
2026-03-29 10:38:49 [auto1.de] INFO: Found listing with ID: GJ72052
2026-03-29 10:38:49 [auto1.de] INFO: Found listing with ID: KJ55573
2026-03-29 10:38:49 [auto1.de] INFO: Found listing with ID: XK87583
2026-03-29 10:38:49 [auto1.de] INFO: Found listing with ID: UT25770
2026-03-29 10:38:49 [auto1.de] INFO: Found listing with ID: YD46257
2026-03-29 10:38:49 [auto1.de] INFO: Found listing with ID: TA14554
2026-03-29 10:38:49 [auto1.de] INFO: Found listing with ID: JT51313
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT51313%27 HTTP/1.1" 200 None
2026-03-29 10:38:49 [auto1.de] INFO: Scrape type for JT51313: 0
2026-03-29 10:38:49 [auto1.de] INFO: Found listing with ID: RP89370
2026-03-29 10:38:49 [auto1.de] INFO: Found listing with ID: DB28845
2026-03-29 10:38:49 [auto1.de] INFO: Found listing with ID: NF88064
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF88064%27 HTTP/1.1" 200 None
2026-03-29 10:38:49 [auto1.de] INFO: Scrape type for NF88064: 0
2026-03-29 10:38:49 [auto1.de] INFO: Found listing with ID: PG30420
2026-03-29 10:38:49 [auto1.de] INFO: Found listing with ID: AN15165
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN15165%27 HTTP/1.1" 200 None
2026-03-29 10:38:49 [auto1.de] INFO: Scrape type for AN15165: 0
2026-03-29 10:38:49 [auto1.de] INFO: Found listing with ID: FX76120
2026-03-29 10:38:49 [auto1.de] INFO: Found listing with ID: JV66840
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV66840%27 HTTP/1.1" 200 None
2026-03-29 10:38:49 [auto1.de] INFO: Scrape type for JV66840: 0
2026-03-29 10:38:49 [auto1.de] INFO: Found listing with ID: UF84610
2026-03-29 10:38:49 [auto1.de] INFO: Found listing with ID: DG61616
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG61616%27 HTTP/1.1" 200 None
2026-03-29 10:38:49 [auto1.de] INFO: Scrape type for DG61616: 0
2026-03-29 10:38:49 [auto1.de] INFO: Found listing with ID: PV33295
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV33295%27 HTTP/1.1" 200 None
2026-03-29 10:38:49 [auto1.de] INFO: Scrape type for PV33295: 0
2026-03-29 10:38:49 [auto1.de] INFO: Found listing with ID: MH20468
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH20468%27 HTTP/1.1" 200 None
2026-03-29 10:38:49 [auto1.de] INFO: Scrape type for MH20468: 0
2026-03-29 10:38:49 [auto1.de] INFO: Found listing with ID: VW15579
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW15579%27 HTTP/1.1" 200 None
2026-03-29 10:38:49 [auto1.de] INFO: Scrape type for VW15579: 0
2026-03-29 10:38:49 [auto1.de] INFO: Found listing with ID: VA07254
2026-03-29 10:38:49 [auto1.de] INFO: Found listing with ID: VE65204
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE65204%27 HTTP/1.1" 200 None
2026-03-29 10:38:49 [auto1.de] INFO: Scrape type for VE65204: 0
2026-03-29 10:38:49 [auto1.de] INFO: Found listing with ID: DZ63876
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ63876%27 HTTP/1.1" 200 None
2026-03-29 10:38:49 [auto1.de] INFO: Scrape type for DZ63876: 0
2026-03-29 10:38:49 [auto1.de] INFO: Found listing with ID: BP69075
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP69075%27 HTTP/1.1" 200 None
2026-03-29 10:38:49 [auto1.de] INFO: Scrape type for BP69075: 0
2026-03-29 10:38:49 [auto1.de] INFO: Found listing with ID: BH45132
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH45132%27 HTTP/1.1" 200 None
2026-03-29 10:38:49 [auto1.de] INFO: Scrape type for BH45132: 0
2026-03-29 10:38:49 [auto1.de] INFO: Found listing with ID: JN58244
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN58244%27 HTTP/1.1" 200 None
2026-03-29 10:38:49 [auto1.de] INFO: Scrape type for JN58244: 0
2026-03-29 10:38:49 [auto1.de] INFO: Found listing with ID: NW39371
2026-03-29 10:38:49 [auto1.de] INFO: Found listing with ID: BR95231
2026-03-29 10:38:49 [auto1.de] INFO: Found listing with ID: XX04518
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX04518%27 HTTP/1.1" 200 None
2026-03-29 10:38:49 [auto1.de] INFO: Scrape type for XX04518: 0
2026-03-29 10:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:50 [auto1.de] INFO: Channel: 24h | Page: 52 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: ZE28536
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE28536%27 HTTP/1.1" 200 None
2026-03-29 10:38:50 [auto1.de] INFO: Scrape type for ZE28536: 0
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: CY45921
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY45921%27 HTTP/1.1" 200 None
2026-03-29 10:38:50 [auto1.de] INFO: Scrape type for CY45921: 0
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: BY42207
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: GM93561
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM93561%27 HTTP/1.1" 200 None
2026-03-29 10:38:50 [auto1.de] INFO: Scrape type for GM93561: 0
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: WT60095
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: SJ09412
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ09412%27 HTTP/1.1" 200 None
2026-03-29 10:38:50 [auto1.de] INFO: Scrape type for SJ09412: 0
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: AR39544
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR39544%27 HTTP/1.1" 200 None
2026-03-29 10:38:50 [auto1.de] INFO: Scrape type for AR39544: 0
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: ZT20326
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: NC65519
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: SV25975
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV25975%27 HTTP/1.1" 200 None
2026-03-29 10:38:50 [auto1.de] INFO: Scrape type for SV25975: 0
2026-03-29 10:38:50 [auto1.de] INFO: Found listing with ID: RW32541
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW32541%27 HTTP/1.1" 200 None
2026-03-29 10:38:50 [auto1.de] INFO: Scrape type for RW32541: 2
2026-03-29 10:38:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f159673-0961-518e-a8e2-302646b757f2 with identifier: RW32541
2026-03-29 10:38:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f159673-0961-518e-a8e2-302646b757f2 with scrape type 2
2026-03-29 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f159673-0961-518e-a8e2-302646b757f2 with scrape type 2
2026-03-29 10:38:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f159673-0961-518e-a8e2-302646b757f2, identifier: RW32541
2026-03-29 10:38:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f159673-0961-518e-a8e2-302646b757f2 with identifier: RW32541
2026-03-29 10:38:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f159673-0961-518e-a8e2-302646b757f2 with identifier: RW32541
2026-03-29 10:38:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f159673-0961-518e-a8e2-302646b757f2 with identifier: RW32541 to the API
2026-03-29 10:38:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:38:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 69,
 'expiration_date': '2026-03-30T15:05:44Z',
 'fuel_type': 'petrol',
 'id': '2f159673-0961-518e-a8e2-302646b757f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW32541',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 37269,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-22',
 'seller_name': None,
 'title': 'Fiat 500 1.2 DolceVita',
 'transmission': 'manual',
 'trim': 'DolceVita',
 'year': 2019}
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW32541%27 HTTP/1.1" 200 None
2026-03-29 10:38:51 [auto1.de] INFO: Saving data for RW32541: {'auction_closing_time': 1774883144.0, 'created_time': 1773228667.10731, 'last_price_update_time': 1774780731.789684}
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RW32541') HTTP/1.1" 204 0
2026-03-29 10:38:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: HZ20287
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: SJ84971
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ84971%27 HTTP/1.1" 200 None
2026-03-29 10:38:51 [auto1.de] INFO: Scrape type for SJ84971: 0
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: MD11027
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: VE80218
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: BN62296
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN62296%27 HTTP/1.1" 200 None
2026-03-29 10:38:51 [auto1.de] INFO: Scrape type for BN62296: 0
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: VL31529
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL31529%27 HTTP/1.1" 200 None
2026-03-29 10:38:51 [auto1.de] INFO: Scrape type for VL31529: 0
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: FU20206
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: LT47109
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: RT27360
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: RH04581
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: XD11713
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: HR62368
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: UH90150
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH90150%27 HTTP/1.1" 200 None
2026-03-29 10:38:51 [auto1.de] INFO: Scrape type for UH90150: 0
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: YH04834
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH04834%27 HTTP/1.1" 200 None
2026-03-29 10:38:51 [auto1.de] INFO: Scrape type for YH04834: 0
2026-03-29 10:38:51 [auto1.de] INFO: Found listing with ID: RK32817
2026-03-29 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK32817%27 HTTP/1.1" 200 None
2026-03-29 10:38:52 [auto1.de] INFO: Scrape type for RK32817: 0
2026-03-29 10:38:52 [auto1.de] INFO: Found listing with ID: LT13241
2026-03-29 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT13241%27 HTTP/1.1" 200 None
2026-03-29 10:38:52 [auto1.de] INFO: Scrape type for LT13241: 0
2026-03-29 10:38:52 [auto1.de] INFO: Found listing with ID: VV47802
2026-03-29 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV47802%27 HTTP/1.1" 200 None
2026-03-29 10:38:52 [auto1.de] INFO: Scrape type for VV47802: 0
2026-03-29 10:38:52 [auto1.de] INFO: Found listing with ID: NW35011
2026-03-29 10:38:52 [auto1.de] INFO: Found listing with ID: CA34642
2026-03-29 10:38:52 [auto1.de] INFO: Found listing with ID: JW84966
2026-03-29 10:38:52 [auto1.de] INFO: Found listing with ID: YH72749
2026-03-29 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH72749%27 HTTP/1.1" 200 None
2026-03-29 10:38:52 [auto1.de] INFO: Scrape type for YH72749: 0
2026-03-29 10:38:52 [auto1.de] INFO: Found listing with ID: UD88757
2026-03-29 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD88757%27 HTTP/1.1" 200 None
2026-03-29 10:38:52 [auto1.de] INFO: Scrape type for UD88757: 0
2026-03-29 10:38:52 [auto1.de] INFO: Found listing with ID: RP50374
2026-03-29 10:38:52 [auto1.de] INFO: Found listing with ID: JP43917
2026-03-29 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP43917%27 HTTP/1.1" 200 None
2026-03-29 10:38:52 [auto1.de] INFO: Scrape type for JP43917: 0
2026-03-29 10:38:52 [auto1.de] INFO: Found listing with ID: GF78107
2026-03-29 10:38:52 [auto1.de] INFO: Found listing with ID: KE92828
2026-03-29 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE92828%27 HTTP/1.1" 200 None
2026-03-29 10:38:52 [auto1.de] INFO: Scrape type for KE92828: 0
2026-03-29 10:38:52 [auto1.de] INFO: Found listing with ID: CG74532
2026-03-29 10:38:52 [auto1.de] INFO: Found listing with ID: SM47095
2026-03-29 10:38:52 [auto1.de] INFO: Found listing with ID: SD86365
2026-03-29 10:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:53 [auto1.de] INFO: Channel: 24h | Page: 53 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: RG31591
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: SZ48596
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: ST98775
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST98775%27 HTTP/1.1" 200 None
2026-03-29 10:38:53 [auto1.de] INFO: Scrape type for ST98775: 0
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: AS96658
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS96658%27 HTTP/1.1" 200 None
2026-03-29 10:38:53 [auto1.de] INFO: Scrape type for AS96658: 0
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: YE46941
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: AD81240
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD81240%27 HTTP/1.1" 200 None
2026-03-29 10:38:53 [auto1.de] INFO: Scrape type for AD81240: 0
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: WM09546
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: MJ25721
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ25721%27 HTTP/1.1" 200 None
2026-03-29 10:38:53 [auto1.de] INFO: Scrape type for MJ25721: 0
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: BR11811
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: KT65416
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT65416%27 HTTP/1.1" 200 None
2026-03-29 10:38:53 [auto1.de] INFO: Scrape type for KT65416: 0
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: GJ62462
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: WG41390
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: DS71504
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: SC00063
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: JY05464
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY05464%27 HTTP/1.1" 200 None
2026-03-29 10:38:53 [auto1.de] INFO: Scrape type for JY05464: 0
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: DF96715
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF96715%27 HTTP/1.1" 200 None
2026-03-29 10:38:53 [auto1.de] INFO: Scrape type for DF96715: 0
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: FY64526
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: WE79254
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: MT28952
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: AE68185
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE68185%27 HTTP/1.1" 200 None
2026-03-29 10:38:53 [auto1.de] INFO: Scrape type for AE68185: 0
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: XC67226
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC67226%27 HTTP/1.1" 200 None
2026-03-29 10:38:53 [auto1.de] INFO: Scrape type for XC67226: 0
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: KX24751
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX24751%27 HTTP/1.1" 200 None
2026-03-29 10:38:53 [auto1.de] INFO: Scrape type for KX24751: 0
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: YT05119
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT05119%27 HTTP/1.1" 200 None
2026-03-29 10:38:53 [auto1.de] INFO: Scrape type for YT05119: 0
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: NK84600
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: WD16900
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD16900%27 HTTP/1.1" 200 None
2026-03-29 10:38:53 [auto1.de] INFO: Scrape type for WD16900: 0
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: TY75534
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: YT16808
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: AW88722
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: CZ09118
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ09118%27 HTTP/1.1" 200 None
2026-03-29 10:38:53 [auto1.de] INFO: Scrape type for CZ09118: 0
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: ZJ19484
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: AP34925
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: JB95370
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: CD75324
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: SX85367
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX85367%27 HTTP/1.1" 200 None
2026-03-29 10:38:53 [auto1.de] INFO: Scrape type for SX85367: 0
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: BD99191
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD99191%27 HTTP/1.1" 200 None
2026-03-29 10:38:53 [auto1.de] INFO: Scrape type for BD99191: 0
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: ZY62714
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: HP95404
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: SL28048
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL28048%27 HTTP/1.1" 200 None
2026-03-29 10:38:53 [auto1.de] INFO: Scrape type for SL28048: 0
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: CN87800
2026-03-29 10:38:53 [auto1.de] INFO: Found listing with ID: MA61541
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA61541%27 HTTP/1.1" 200 None
2026-03-29 10:38:53 [auto1.de] INFO: Scrape type for MA61541: 0
2026-03-29 10:38:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:54 [auto1.de] INFO: Channel: 24h | Page: 54 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: GN68043
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: EW37787
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW37787%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for EW37787: 0
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: CR83846
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: FU85370
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU85370%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for FU85370: 0
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: HC91159
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC91159%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for HC91159: 0
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: DZ26190
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ26190%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for DZ26190: 0
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: XU38066
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU38066%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for XU38066: 0
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: ZU48886
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU48886%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for ZU48886: 0
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: RM51665
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM51665%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for RM51665: 0
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: PP42616
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP42616%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for PP42616: 0
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: LL15014
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL15014%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for LL15014: 0
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: UH99848
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: HG64056
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: NP05566
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: WW82569
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW82569%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for WW82569: 0
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: MP93113
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: WZ32773
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ32773%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for WZ32773: 0
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: RL83292
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: VX99653
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: BN83173
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN83173%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for BN83173: 0
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: GR33012
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR33012%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for GR33012: 0
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: AM60777
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM60777%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for AM60777: 0
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: SR08314
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: MH03365
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH03365%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for MH03365: 0
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: ZR44160
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR44160%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for ZR44160: 0
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: GP99988
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP99988%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for GP99988: 0
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: BB98458
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: UK52286
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK52286%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for UK52286: 0
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: PY88123
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: ZV84359
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: ZR92554
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR92554%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for ZR92554: 0
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: XD42848
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD42848%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for XD42848: 0
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: MZ39955
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ39955%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for MZ39955: 0
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: FA96638
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA96638%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for FA96638: 0
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: XR52886
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR52886%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for XR52886: 0
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: DF95353
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: TE07006
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE07006%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for TE07006: 0
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: AB88110
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: KC26030
2026-03-29 10:38:54 [auto1.de] INFO: Found listing with ID: FE62159
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE62159%27 HTTP/1.1" 200 None
2026-03-29 10:38:54 [auto1.de] INFO: Scrape type for FE62159: 0
2026-03-29 10:38:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:55 [auto1.de] INFO: Channel: 24h | Page: 55 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: GM35887
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: ZK01329
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK01329%27 HTTP/1.1" 200 None
2026-03-29 10:38:55 [auto1.de] INFO: Scrape type for ZK01329: 0
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: MC12469
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC12469%27 HTTP/1.1" 200 None
2026-03-29 10:38:55 [auto1.de] INFO: Scrape type for MC12469: 0
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: TB37654
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB37654%27 HTTP/1.1" 200 None
2026-03-29 10:38:55 [auto1.de] INFO: Scrape type for TB37654: 0
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: PM23375
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: HR10791
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: SS30943
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS30943%27 HTTP/1.1" 200 None
2026-03-29 10:38:55 [auto1.de] INFO: Scrape type for SS30943: 0
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: BB15265
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB15265%27 HTTP/1.1" 200 None
2026-03-29 10:38:55 [auto1.de] INFO: Scrape type for BB15265: 0
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: RH02243
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH02243%27 HTTP/1.1" 200 None
2026-03-29 10:38:55 [auto1.de] INFO: Scrape type for RH02243: 0
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: BW77657
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: PH96915
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH96915%27 HTTP/1.1" 200 None
2026-03-29 10:38:55 [auto1.de] INFO: Scrape type for PH96915: 0
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: DY95504
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY95504%27 HTTP/1.1" 200 None
2026-03-29 10:38:55 [auto1.de] INFO: Scrape type for DY95504: 0
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: NK83819
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: EM07898
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM07898%27 HTTP/1.1" 200 None
2026-03-29 10:38:55 [auto1.de] INFO: Scrape type for EM07898: 0
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: ZE29906
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: EP05122
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP05122%27 HTTP/1.1" 200 None
2026-03-29 10:38:55 [auto1.de] INFO: Scrape type for EP05122: 0
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: YT52370
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT52370%27 HTTP/1.1" 200 None
2026-03-29 10:38:55 [auto1.de] INFO: Scrape type for YT52370: 0
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: LL09458
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: ZZ59930
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: KR50591
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR50591%27 HTTP/1.1" 200 None
2026-03-29 10:38:55 [auto1.de] INFO: Scrape type for KR50591: 0
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: AU82814
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: HH56316
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: LX86336
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: CD13721
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD13721%27 HTTP/1.1" 200 None
2026-03-29 10:38:55 [auto1.de] INFO: Scrape type for CD13721: 0
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: XY67519
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: VT42792
2026-03-29 10:38:55 [auto1.de] INFO: Found listing with ID: WF02810
2026-03-29 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF02810%27 HTTP/1.1" 200 None
2026-03-29 10:38:56 [auto1.de] INFO: Scrape type for WF02810: 0
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: FX25662
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: XF83287
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: PG24274
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG24274%27 HTTP/1.1" 200 None
2026-03-29 10:38:56 [auto1.de] INFO: Scrape type for PG24274: 0
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: RX80548
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: TL84937
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL84937%27 HTTP/1.1" 200 None
2026-03-29 10:38:56 [auto1.de] INFO: Scrape type for TL84937: 0
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: HJ88633
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ88633%27 HTTP/1.1" 200 None
2026-03-29 10:38:56 [auto1.de] INFO: Scrape type for HJ88633: 0
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: YT57989
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: NY75597
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY75597%27 HTTP/1.1" 200 None
2026-03-29 10:38:56 [auto1.de] INFO: Scrape type for NY75597: 0
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: JS13151
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: WX91762
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: NF38330
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: GU59921
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU59921%27 HTTP/1.1" 200 None
2026-03-29 10:38:56 [auto1.de] INFO: Scrape type for GU59921: 0
2026-03-29 10:38:56 [auto1.de] INFO: Found listing with ID: PP10507
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP10507%27 HTTP/1.1" 200 None
2026-03-29 10:38:56 [auto1.de] INFO: Scrape type for PP10507: 0
2026-03-29 10:38:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:57 [auto1.de] INFO: Channel: 24h | Page: 56 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: SD15904
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD15904%27 HTTP/1.1" 200 None
2026-03-29 10:38:57 [auto1.de] INFO: Scrape type for SD15904: 0
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: WN67073
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: BN76417
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: ZS47676
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: CM15300
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: EC93517
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: ME06173
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME06173%27 HTTP/1.1" 200 None
2026-03-29 10:38:57 [auto1.de] INFO: Scrape type for ME06173: 0
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: BG81908
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG81908%27 HTTP/1.1" 200 None
2026-03-29 10:38:57 [auto1.de] INFO: Scrape type for BG81908: 0
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: YN35790
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: GJ75374
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ75374%27 HTTP/1.1" 200 None
2026-03-29 10:38:57 [auto1.de] INFO: Scrape type for GJ75374: 0
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: ND34621
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: LT29180
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: HH04622
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH04622%27 HTTP/1.1" 200 None
2026-03-29 10:38:57 [auto1.de] INFO: Scrape type for HH04622: 0
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: AW08292
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: EV97888
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV97888%27 HTTP/1.1" 200 None
2026-03-29 10:38:57 [auto1.de] INFO: Scrape type for EV97888: 0
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: EY95124
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: PL64975
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL64975%27 HTTP/1.1" 200 None
2026-03-29 10:38:57 [auto1.de] INFO: Scrape type for PL64975: 0
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: BG10671
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG10671%27 HTTP/1.1" 200 None
2026-03-29 10:38:57 [auto1.de] INFO: Scrape type for BG10671: 0
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: VC63070
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: JF36424
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF36424%27 HTTP/1.1" 200 None
2026-03-29 10:38:57 [auto1.de] INFO: Scrape type for JF36424: 0
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: TF71705
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: BT97147
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: AN46464
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN46464%27 HTTP/1.1" 200 None
2026-03-29 10:38:57 [auto1.de] INFO: Scrape type for AN46464: 0
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: WT86563
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: HP37567
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP37567%27 HTTP/1.1" 200 None
2026-03-29 10:38:57 [auto1.de] INFO: Scrape type for HP37567: 0
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: PS47170
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: AN41414
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN41414%27 HTTP/1.1" 200 None
2026-03-29 10:38:57 [auto1.de] INFO: Scrape type for AN41414: 0
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: YR25980
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR25980%27 HTTP/1.1" 200 None
2026-03-29 10:38:57 [auto1.de] INFO: Scrape type for YR25980: 0
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: ZY58366
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY58366%27 HTTP/1.1" 200 None
2026-03-29 10:38:57 [auto1.de] INFO: Scrape type for ZY58366: 0
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: UT75774
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT75774%27 HTTP/1.1" 200 None
2026-03-29 10:38:57 [auto1.de] INFO: Scrape type for UT75774: 0
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: DP30062
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: CD69180
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD69180%27 HTTP/1.1" 200 None
2026-03-29 10:38:57 [auto1.de] INFO: Scrape type for CD69180: 0
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: RM03411
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: AG08443
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: LT34656
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT34656%27 HTTP/1.1" 200 None
2026-03-29 10:38:57 [auto1.de] INFO: Scrape type for LT34656: 0
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: YJ47814
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: MM42204
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM42204%27 HTTP/1.1" 200 None
2026-03-29 10:38:57 [auto1.de] INFO: Scrape type for MM42204: 0
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: VX90434
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX90434%27 HTTP/1.1" 200 None
2026-03-29 10:38:57 [auto1.de] INFO: Scrape type for VX90434: 0
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: XZ76786
2026-03-29 10:38:57 [auto1.de] INFO: Found listing with ID: KX12116
2026-03-29 10:38:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:38:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:38:58 [auto1.de] INFO: Channel: 24h | Page: 57 | totalHits: 6726 | hits on page: 40
2026-03-29 10:38:58 [auto1.de] INFO: Found listing with ID: AJ16531
2026-03-29 10:38:58 [auto1.de] INFO: Found listing with ID: TD56842
2026-03-29 10:38:58 [auto1.de] INFO: Found listing with ID: LL25204
2026-03-29 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL25204%27 HTTP/1.1" 200 None
2026-03-29 10:38:58 [auto1.de] INFO: Scrape type for LL25204: 0
2026-03-29 10:38:58 [auto1.de] INFO: Found listing with ID: YT23493
2026-03-29 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT23493%27 HTTP/1.1" 200 None
2026-03-29 10:38:58 [auto1.de] INFO: Scrape type for YT23493: 0
2026-03-29 10:38:58 [auto1.de] INFO: Found listing with ID: RK12906
2026-03-29 10:38:58 [auto1.de] INFO: Found listing with ID: KR99013
2026-03-29 10:38:58 [auto1.de] INFO: Found listing with ID: AE08080
2026-03-29 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE08080%27 HTTP/1.1" 200 None
2026-03-29 10:38:58 [auto1.de] INFO: Scrape type for AE08080: 0
2026-03-29 10:38:58 [auto1.de] INFO: Found listing with ID: UB50562
2026-03-29 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB50562%27 HTTP/1.1" 200 None
2026-03-29 10:38:58 [auto1.de] INFO: Scrape type for UB50562: 0
2026-03-29 10:38:58 [auto1.de] INFO: Found listing with ID: VB93359
2026-03-29 10:38:58 [auto1.de] INFO: Found listing with ID: WW12135
2026-03-29 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW12135%27 HTTP/1.1" 200 None
2026-03-29 10:38:58 [auto1.de] INFO: Scrape type for WW12135: 0
2026-03-29 10:38:58 [auto1.de] INFO: Found listing with ID: HD30169
2026-03-29 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD30169%27 HTTP/1.1" 200 None
2026-03-29 10:38:58 [auto1.de] INFO: Scrape type for HD30169: 0
2026-03-29 10:38:58 [auto1.de] INFO: Found listing with ID: MD55722
2026-03-29 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD55722%27 HTTP/1.1" 200 None
2026-03-29 10:38:58 [auto1.de] INFO: Scrape type for MD55722: 0
2026-03-29 10:38:58 [auto1.de] INFO: Found listing with ID: DC90555
2026-03-29 10:38:58 [auto1.de] INFO: Found listing with ID: EF47074
2026-03-29 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF47074%27 HTTP/1.1" 200 None
2026-03-29 10:38:58 [auto1.de] INFO: Scrape type for EF47074: 0
2026-03-29 10:38:58 [auto1.de] INFO: Found listing with ID: BR24647
2026-03-29 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR24647%27 HTTP/1.1" 200 None
2026-03-29 10:38:58 [auto1.de] INFO: Scrape type for BR24647: 0
2026-03-29 10:38:58 [auto1.de] INFO: Found listing with ID: AL45510
2026-03-29 10:38:58 [auto1.de] INFO: Found listing with ID: DE84104
2026-03-29 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE84104%27 HTTP/1.1" 200 None
2026-03-29 10:38:58 [auto1.de] INFO: Scrape type for DE84104: 0
2026-03-29 10:38:58 [auto1.de] INFO: Found listing with ID: WZ86962
2026-03-29 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ86962%27 HTTP/1.1" 200 None
2026-03-29 10:38:58 [auto1.de] INFO: Scrape type for WZ86962: 0
2026-03-29 10:38:58 [auto1.de] INFO: Found listing with ID: XG02124
2026-03-29 10:38:58 [auto1.de] INFO: Found listing with ID: GJ61824
2026-03-29 10:38:58 [auto1.de] INFO: Found listing with ID: AK65785
2026-03-29 10:38:58 [auto1.de] INFO: Found listing with ID: FF73158
2026-03-29 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF73158%27 HTTP/1.1" 200 None
2026-03-29 10:38:58 [auto1.de] INFO: Scrape type for FF73158: 0
2026-03-29 10:38:58 [auto1.de] INFO: Found listing with ID: YH76604
2026-03-29 10:38:58 [auto1.de] INFO: Found listing with ID: EG34201
2026-03-29 10:38:58 [auto1.de] INFO: Found listing with ID: ZD30774
2026-03-29 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD30774%27 HTTP/1.1" 200 None
2026-03-29 10:38:58 [auto1.de] INFO: Scrape type for ZD30774: 0
2026-03-29 10:38:58 [auto1.de] INFO: Found listing with ID: AW17852
2026-03-29 10:38:58 [auto1.de] INFO: Found listing with ID: AY57435
2026-03-29 10:38:58 [auto1.de] INFO: Found listing with ID: NJ66077
2026-03-29 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ66077%27 HTTP/1.1" 200 None
2026-03-29 10:38:58 [auto1.de] INFO: Scrape type for NJ66077: 0
2026-03-29 10:38:58 [auto1.de] INFO: Found listing with ID: UK09737
2026-03-29 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK09737%27 HTTP/1.1" 200 None
2026-03-29 10:38:58 [auto1.de] INFO: Scrape type for UK09737: 0
2026-03-29 10:38:58 [auto1.de] INFO: Found listing with ID: ZZ79893
2026-03-29 10:38:58 [auto1.de] INFO: Found listing with ID: DY67323
2026-03-29 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY67323%27 HTTP/1.1" 200 None
2026-03-29 10:38:58 [auto1.de] INFO: Scrape type for DY67323: 0
2026-03-29 10:38:58 [auto1.de] INFO: Found listing with ID: MT21792
2026-03-29 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT21792%27 HTTP/1.1" 200 None
2026-03-29 10:38:58 [auto1.de] INFO: Scrape type for MT21792: 0
2026-03-29 10:38:58 [auto1.de] INFO: Found listing with ID: AV13612
2026-03-29 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV13612%27 HTTP/1.1" 200 None
2026-03-29 10:38:59 [auto1.de] INFO: Scrape type for AV13612: 0
2026-03-29 10:38:59 [auto1.de] INFO: Found listing with ID: VX98591
2026-03-29 10:38:59 [auto1.de] INFO: Found listing with ID: BD44201
2026-03-29 10:38:59 [auto1.de] INFO: Found listing with ID: FY04572
2026-03-29 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY04572%27 HTTP/1.1" 200 None
2026-03-29 10:38:59 [auto1.de] INFO: Scrape type for FY04572: 0
2026-03-29 10:38:59 [auto1.de] INFO: Found listing with ID: NG90770
2026-03-29 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG90770%27 HTTP/1.1" 200 None
2026-03-29 10:38:59 [auto1.de] INFO: Scrape type for NG90770: 0
2026-03-29 10:38:59 [auto1.de] INFO: Found listing with ID: NG07529
2026-03-29 10:38:59 [auto1.de] INFO: Found listing with ID: JY21775
2026-03-29 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY21775%27 HTTP/1.1" 200 None
2026-03-29 10:38:59 [auto1.de] INFO: Scrape type for JY21775: 0
2026-03-29 10:38:59 [auto1.de] INFO: Found listing with ID: DL69348
2026-03-29 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL69348%27 HTTP/1.1" 200 None
2026-03-29 10:38:59 [auto1.de] INFO: Scrape type for DL69348: 0
2026-03-29 10:38:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:00 [auto1.de] INFO: Channel: 24h | Page: 58 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: RK40199
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK40199%27 HTTP/1.1" 200 None
2026-03-29 10:39:00 [auto1.de] INFO: Scrape type for RK40199: 0
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: LR76257
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: YY97857
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: DS47068
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: DC50657
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: NX23620
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX23620%27 HTTP/1.1" 200 None
2026-03-29 10:39:00 [auto1.de] INFO: Scrape type for NX23620: 0
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: XU56450
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU56450%27 HTTP/1.1" 200 None
2026-03-29 10:39:00 [auto1.de] INFO: Scrape type for XU56450: 0
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: BC73225
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC73225%27 HTTP/1.1" 200 None
2026-03-29 10:39:00 [auto1.de] INFO: Scrape type for BC73225: 0
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: HL62100
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL62100%27 HTTP/1.1" 200 None
2026-03-29 10:39:00 [auto1.de] INFO: Scrape type for HL62100: 0
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: YA77480
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA77480%27 HTTP/1.1" 200 None
2026-03-29 10:39:00 [auto1.de] INFO: Scrape type for YA77480: 0
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: BT35414
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT35414%27 HTTP/1.1" 200 None
2026-03-29 10:39:00 [auto1.de] INFO: Scrape type for BT35414: 0
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: UX10113
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: LC77842
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: DP87789
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP87789%27 HTTP/1.1" 200 None
2026-03-29 10:39:00 [auto1.de] INFO: Scrape type for DP87789: 0
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: YF78558
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: BJ94385
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ94385%27 HTTP/1.1" 200 None
2026-03-29 10:39:00 [auto1.de] INFO: Scrape type for BJ94385: 0
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: MS73974
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: EN83370
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN83370%27 HTTP/1.1" 200 None
2026-03-29 10:39:00 [auto1.de] INFO: Scrape type for EN83370: 0
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: TE35535
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: AH38821
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH38821%27 HTTP/1.1" 200 None
2026-03-29 10:39:00 [auto1.de] INFO: Scrape type for AH38821: 0
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: SA59196
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA59196%27 HTTP/1.1" 200 None
2026-03-29 10:39:00 [auto1.de] INFO: Scrape type for SA59196: 0
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: XE26333
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: WZ27429
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ27429%27 HTTP/1.1" 200 None
2026-03-29 10:39:00 [auto1.de] INFO: Scrape type for WZ27429: 0
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: NX68666
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: RK13717
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: EL91395
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: MC36419
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC36419%27 HTTP/1.1" 200 None
2026-03-29 10:39:00 [auto1.de] INFO: Scrape type for MC36419: 0
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: KN65444
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: YF83541
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF83541%27 HTTP/1.1" 200 None
2026-03-29 10:39:00 [auto1.de] INFO: Scrape type for YF83541: 0
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: EB01944
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: SX08499
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: BK25487
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK25487%27 HTTP/1.1" 200 None
2026-03-29 10:39:00 [auto1.de] INFO: Scrape type for BK25487: 0
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: EA13854
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA13854%27 HTTP/1.1" 200 None
2026-03-29 10:39:00 [auto1.de] INFO: Scrape type for EA13854: 0
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: TR96368
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: NJ99986
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: KM66171
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: TU73668
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: PT08625
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: HM95018
2026-03-29 10:39:00 [auto1.de] INFO: Found listing with ID: KF98082
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF98082%27 HTTP/1.1" 200 None
2026-03-29 10:39:00 [auto1.de] INFO: Scrape type for KF98082: 0
2026-03-29 10:39:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:04 [auto1.de] INFO: Channel: 24h | Page: 59 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:04 [auto1.de] INFO: Found listing with ID: JR56038
2026-03-29 10:39:04 [auto1.de] INFO: Found listing with ID: MH67551
2026-03-29 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH67551%27 HTTP/1.1" 200 None
2026-03-29 10:39:04 [auto1.de] INFO: Scrape type for MH67551: 0
2026-03-29 10:39:04 [auto1.de] INFO: Found listing with ID: SA94096
2026-03-29 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA94096%27 HTTP/1.1" 200 None
2026-03-29 10:39:04 [auto1.de] INFO: Scrape type for SA94096: 0
2026-03-29 10:39:04 [auto1.de] INFO: Found listing with ID: HE33973
2026-03-29 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE33973%27 HTTP/1.1" 200 None
2026-03-29 10:39:04 [auto1.de] INFO: Scrape type for HE33973: 0
2026-03-29 10:39:04 [auto1.de] INFO: Found listing with ID: ZR39643
2026-03-29 10:39:04 [auto1.de] INFO: Found listing with ID: PJ34004
2026-03-29 10:39:04 [auto1.de] INFO: Found listing with ID: BK49064
2026-03-29 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK49064%27 HTTP/1.1" 200 None
2026-03-29 10:39:04 [auto1.de] INFO: Scrape type for BK49064: 0
2026-03-29 10:39:04 [auto1.de] INFO: Found listing with ID: HA65377
2026-03-29 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA65377%27 HTTP/1.1" 200 None
2026-03-29 10:39:04 [auto1.de] INFO: Scrape type for HA65377: 0
2026-03-29 10:39:04 [auto1.de] INFO: Found listing with ID: AR72060
2026-03-29 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR72060%27 HTTP/1.1" 200 None
2026-03-29 10:39:04 [auto1.de] INFO: Scrape type for AR72060: 0
2026-03-29 10:39:04 [auto1.de] INFO: Found listing with ID: JL65692
2026-03-29 10:39:04 [auto1.de] INFO: Found listing with ID: MX37752
2026-03-29 10:39:04 [auto1.de] INFO: Found listing with ID: BG36952
2026-03-29 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG36952%27 HTTP/1.1" 200 None
2026-03-29 10:39:04 [auto1.de] INFO: Scrape type for BG36952: 0
2026-03-29 10:39:04 [auto1.de] INFO: Found listing with ID: WK78247
2026-03-29 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK78247%27 HTTP/1.1" 200 None
2026-03-29 10:39:04 [auto1.de] INFO: Scrape type for WK78247: 0
2026-03-29 10:39:04 [auto1.de] INFO: Found listing with ID: XR06088
2026-03-29 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR06088%27 HTTP/1.1" 200 None
2026-03-29 10:39:04 [auto1.de] INFO: Scrape type for XR06088: 0
2026-03-29 10:39:04 [auto1.de] INFO: Found listing with ID: LK79875
2026-03-29 10:39:04 [auto1.de] INFO: Found listing with ID: AG47249
2026-03-29 10:39:04 [auto1.de] INFO: Found listing with ID: NB80689
2026-03-29 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB80689%27 HTTP/1.1" 200 None
2026-03-29 10:39:04 [auto1.de] INFO: Scrape type for NB80689: 0
2026-03-29 10:39:04 [auto1.de] INFO: Found listing with ID: RY74387
2026-03-29 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY74387%27 HTTP/1.1" 200 None
2026-03-29 10:39:04 [auto1.de] INFO: Scrape type for RY74387: 0
2026-03-29 10:39:04 [auto1.de] INFO: Found listing with ID: LU05399
2026-03-29 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU05399%27 HTTP/1.1" 200 None
2026-03-29 10:39:04 [auto1.de] INFO: Scrape type for LU05399: 0
2026-03-29 10:39:04 [auto1.de] INFO: Found listing with ID: CG37659
2026-03-29 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG37659%27 HTTP/1.1" 200 None
2026-03-29 10:39:04 [auto1.de] INFO: Scrape type for CG37659: 0
2026-03-29 10:39:04 [auto1.de] INFO: Found listing with ID: LK34875
2026-03-29 10:39:04 [auto1.de] INFO: Found listing with ID: EY55649
2026-03-29 10:39:04 [auto1.de] INFO: Found listing with ID: ZM12960
2026-03-29 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM12960%27 HTTP/1.1" 200 None
2026-03-29 10:39:04 [auto1.de] INFO: Scrape type for ZM12960: 0
2026-03-29 10:39:04 [auto1.de] INFO: Found listing with ID: NH13691
2026-03-29 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH13691%27 HTTP/1.1" 200 None
2026-03-29 10:39:04 [auto1.de] INFO: Scrape type for NH13691: 0
2026-03-29 10:39:04 [auto1.de] INFO: Found listing with ID: DB46013
2026-03-29 10:39:04 [auto1.de] INFO: Found listing with ID: HU88385
2026-03-29 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU88385%27 HTTP/1.1" 200 None
2026-03-29 10:39:04 [auto1.de] INFO: Scrape type for HU88385: 2
2026-03-29 10:39:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a2f53a0-5a13-5302-9d04-02e01fe32665 with identifier: HU88385
2026-03-29 10:39:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a2f53a0-5a13-5302-9d04-02e01fe32665 with scrape type 2
2026-03-29 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a2f53a0-5a13-5302-9d04-02e01fe32665 with scrape type 2
2026-03-29 10:39:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a2f53a0-5a13-5302-9d04-02e01fe32665, identifier: HU88385
2026-03-29 10:39:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a2f53a0-5a13-5302-9d04-02e01fe32665 with identifier: HU88385
2026-03-29 10:39:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a2f53a0-5a13-5302-9d04-02e01fe32665 with identifier: HU88385
2026-03-29 10:39:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a2f53a0-5a13-5302-9d04-02e01fe32665 with identifier: HU88385 to the API
2026-03-29 10:39:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:39:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:39:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:20:46Z',
 'fuel_type': 'diesel',
 'id': '9a2f53a0-5a13-5302-9d04-02e01fe32665',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU88385',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 352212,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-19',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 250 CDI 4Matic BlueEfficiency',
 'transmission': 'automatic',
 'trim': '4Matic BlueEfficiency',
 'year': 2011}
2026-03-29 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU88385%27 HTTP/1.1" 200 None
2026-03-29 10:39:06 [auto1.de] INFO: Saving data for HU88385: {'auction_closing_time': 1774884046.0, 'created_time': 1773945927.372912, 'last_price_update_time': 1774780746.852079}
2026-03-29 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HU88385') HTTP/1.1" 204 0
2026-03-29 10:39:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:06 [auto1.de] INFO: Found listing with ID: XB43693
2026-03-29 10:39:06 [auto1.de] INFO: Found listing with ID: ER51376
2026-03-29 10:39:06 [auto1.de] INFO: Found listing with ID: MG81975
2026-03-29 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG81975%27 HTTP/1.1" 200 None
2026-03-29 10:39:06 [auto1.de] INFO: Scrape type for MG81975: 0
2026-03-29 10:39:06 [auto1.de] INFO: Found listing with ID: BV10728
2026-03-29 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV10728%27 HTTP/1.1" 200 None
2026-03-29 10:39:06 [auto1.de] INFO: Scrape type for BV10728: 0
2026-03-29 10:39:06 [auto1.de] INFO: Found listing with ID: HS53864
2026-03-29 10:39:06 [auto1.de] INFO: Found listing with ID: EU79634
2026-03-29 10:39:06 [auto1.de] INFO: Found listing with ID: RR35143
2026-03-29 10:39:06 [auto1.de] INFO: Found listing with ID: XW28946
2026-03-29 10:39:06 [auto1.de] INFO: Found listing with ID: HX49915
2026-03-29 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX49915%27 HTTP/1.1" 200 None
2026-03-29 10:39:07 [auto1.de] INFO: Scrape type for HX49915: 2
2026-03-29 10:39:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28acd615-2ad7-5dde-aed3-cc4989013e84 with identifier: HX49915
2026-03-29 10:39:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28acd615-2ad7-5dde-aed3-cc4989013e84 with scrape type 2
2026-03-29 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28acd615-2ad7-5dde-aed3-cc4989013e84 with scrape type 2
2026-03-29 10:39:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28acd615-2ad7-5dde-aed3-cc4989013e84, identifier: HX49915
2026-03-29 10:39:07 [scrapy.extensions.logstats] INFO: Crawled 121 pages (at 33 pages/min), scraped 234 items (at 10 items/min)
2026-03-29 10:39:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 160MiB
2026-03-29 10:39:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28acd615-2ad7-5dde-aed3-cc4989013e84 with identifier: HX49915
2026-03-29 10:39:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28acd615-2ad7-5dde-aed3-cc4989013e84 with identifier: HX49915
2026-03-29 10:39:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28acd615-2ad7-5dde-aed3-cc4989013e84 with identifier: HX49915 to the API
2026-03-29 10:39:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:39:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:34:17Z',
 'fuel_type': 'petrol',
 'id': '28acd615-2ad7-5dde-aed3-cc4989013e84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX49915',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 47182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-13',
 'seller_name': None,
 'title': 'Kia XCeed 1.6 TGDI Black Xdition',
 'transmission': 'automatic',
 'trim': 'Black Xdition',
 'year': 2022}
2026-03-29 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX49915%27 HTTP/1.1" 200 None
2026-03-29 10:39:07 [auto1.de] INFO: Saving data for HX49915: {'auction_closing_time': 1774884857.0, 'created_time': 1773382553.038197, 'last_price_update_time': 1774780747.548964}
2026-03-29 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX49915') HTTP/1.1" 204 0
2026-03-29 10:39:07 [auto1.de] INFO: Found listing with ID: KJ96980
2026-03-29 10:39:07 [auto1.de] INFO: Found listing with ID: DM70837
2026-03-29 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM70837%27 HTTP/1.1" 200 None
2026-03-29 10:39:07 [auto1.de] INFO: Scrape type for DM70837: 0
2026-03-29 10:39:07 [auto1.de] INFO: Found listing with ID: SK20956
2026-03-29 10:39:07 [auto1.de] INFO: Found listing with ID: SA39123
2026-03-29 10:39:07 [auto1.de] INFO: Found listing with ID: KE50897
2026-03-29 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE50897%27 HTTP/1.1" 200 None
2026-03-29 10:39:07 [auto1.de] INFO: Scrape type for KE50897: 0
2026-03-29 10:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:08 [auto1.de] INFO: Channel: 24h | Page: 60 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: GE03555
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: BL07705
2026-03-29 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL07705%27 HTTP/1.1" 200 None
2026-03-29 10:39:08 [auto1.de] INFO: Scrape type for BL07705: 0
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: LM98964
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: AM64478
2026-03-29 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM64478%27 HTTP/1.1" 200 None
2026-03-29 10:39:08 [auto1.de] INFO: Scrape type for AM64478: 0
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: AB40080
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: TX92660
2026-03-29 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX92660%27 HTTP/1.1" 200 None
2026-03-29 10:39:08 [auto1.de] INFO: Scrape type for TX92660: 0
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: RP72323
2026-03-29 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP72323%27 HTTP/1.1" 200 None
2026-03-29 10:39:08 [auto1.de] INFO: Scrape type for RP72323: 0
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: BJ98180
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: CF85526
2026-03-29 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF85526%27 HTTP/1.1" 200 None
2026-03-29 10:39:08 [auto1.de] INFO: Scrape type for CF85526: 0
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: GX91022
2026-03-29 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX91022%27 HTTP/1.1" 200 None
2026-03-29 10:39:08 [auto1.de] INFO: Scrape type for GX91022: 0
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: PY37454
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: YJ19270
2026-03-29 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ19270%27 HTTP/1.1" 200 None
2026-03-29 10:39:08 [auto1.de] INFO: Scrape type for YJ19270: 0
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: UA56207
2026-03-29 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA56207%27 HTTP/1.1" 200 None
2026-03-29 10:39:08 [auto1.de] INFO: Scrape type for UA56207: 0
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: KL79607
2026-03-29 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL79607%27 HTTP/1.1" 200 None
2026-03-29 10:39:08 [auto1.de] INFO: Scrape type for KL79607: 0
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: RZ53370
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: YL76472
2026-03-29 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL76472%27 HTTP/1.1" 200 None
2026-03-29 10:39:08 [auto1.de] INFO: Scrape type for YL76472: 0
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: PN22226
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: YJ47160
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: HG88982
2026-03-29 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG88982%27 HTTP/1.1" 200 None
2026-03-29 10:39:08 [auto1.de] INFO: Scrape type for HG88982: 0
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: DL54594
2026-03-29 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL54594%27 HTTP/1.1" 200 None
2026-03-29 10:39:08 [auto1.de] INFO: Scrape type for DL54594: 0
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: GU43225
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: MR73293
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: UG40068
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: JS31219
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: ED43113
2026-03-29 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED43113%27 HTTP/1.1" 200 None
2026-03-29 10:39:08 [auto1.de] INFO: Scrape type for ED43113: 0
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: BC97155
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: WG78869
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: BW09320
2026-03-29 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW09320%27 HTTP/1.1" 200 None
2026-03-29 10:39:08 [auto1.de] INFO: Scrape type for BW09320: 0
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: TF26076
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: NR99017
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: HB50510
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: VG26326
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: WM19192
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: VG31593
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: EP13980
2026-03-29 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP13980%27 HTTP/1.1" 200 None
2026-03-29 10:39:08 [auto1.de] INFO: Scrape type for EP13980: 0
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: EE19276
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: VT68593
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: UM92745
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: GP19513
2026-03-29 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP19513%27 HTTP/1.1" 200 None
2026-03-29 10:39:08 [auto1.de] INFO: Scrape type for GP19513: 0
2026-03-29 10:39:08 [auto1.de] INFO: Found listing with ID: DE37083
2026-03-29 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE37083%27 HTTP/1.1" 200 None
2026-03-29 10:39:08 [auto1.de] INFO: Scrape type for DE37083: 0
2026-03-29 10:39:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:09 [auto1.de] INFO: Channel: 24h | Page: 61 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:09 [auto1.de] INFO: Found listing with ID: YA08912
2026-03-29 10:39:09 [auto1.de] INFO: Found listing with ID: ZT19745
2026-03-29 10:39:09 [auto1.de] INFO: Found listing with ID: VB96558
2026-03-29 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB96558%27 HTTP/1.1" 200 None
2026-03-29 10:39:09 [auto1.de] INFO: Scrape type for VB96558: 0
2026-03-29 10:39:09 [auto1.de] INFO: Found listing with ID: DG34308
2026-03-29 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG34308%27 HTTP/1.1" 200 None
2026-03-29 10:39:09 [auto1.de] INFO: Scrape type for DG34308: 0
2026-03-29 10:39:09 [auto1.de] INFO: Found listing with ID: JF43262
2026-03-29 10:39:09 [auto1.de] INFO: Found listing with ID: KN67174
2026-03-29 10:39:09 [auto1.de] INFO: Found listing with ID: UW98982
2026-03-29 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW98982%27 HTTP/1.1" 200 None
2026-03-29 10:39:09 [auto1.de] INFO: Scrape type for UW98982: 0
2026-03-29 10:39:09 [auto1.de] INFO: Found listing with ID: EX72807
2026-03-29 10:39:09 [auto1.de] INFO: Found listing with ID: TL65156
2026-03-29 10:39:09 [auto1.de] INFO: Found listing with ID: WP12836
2026-03-29 10:39:09 [auto1.de] INFO: Found listing with ID: NE62435
2026-03-29 10:39:09 [auto1.de] INFO: Found listing with ID: SM13407
2026-03-29 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM13407%27 HTTP/1.1" 200 None
2026-03-29 10:39:09 [auto1.de] INFO: Scrape type for SM13407: 0
2026-03-29 10:39:09 [auto1.de] INFO: Found listing with ID: CK84470
2026-03-29 10:39:09 [auto1.de] INFO: Found listing with ID: KZ71348
2026-03-29 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ71348%27 HTTP/1.1" 200 None
2026-03-29 10:39:09 [auto1.de] INFO: Scrape type for KZ71348: 0
2026-03-29 10:39:09 [auto1.de] INFO: Found listing with ID: GB59587
2026-03-29 10:39:09 [auto1.de] INFO: Found listing with ID: DE22331
2026-03-29 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE22331%27 HTTP/1.1" 200 None
2026-03-29 10:39:09 [auto1.de] INFO: Scrape type for DE22331: 0
2026-03-29 10:39:09 [auto1.de] INFO: Found listing with ID: GP54397
2026-03-29 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP54397%27 HTTP/1.1" 200 None
2026-03-29 10:39:09 [auto1.de] INFO: Scrape type for GP54397: 0
2026-03-29 10:39:09 [auto1.de] INFO: Found listing with ID: FM56481
2026-03-29 10:39:09 [auto1.de] INFO: Found listing with ID: XZ96543
2026-03-29 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ96543%27 HTTP/1.1" 200 None
2026-03-29 10:39:09 [auto1.de] INFO: Scrape type for XZ96543: 0
2026-03-29 10:39:09 [auto1.de] INFO: Found listing with ID: UA60360
2026-03-29 10:39:09 [auto1.de] INFO: Found listing with ID: PW80627
2026-03-29 10:39:09 [auto1.de] INFO: Found listing with ID: AH65179
2026-03-29 10:39:09 [auto1.de] INFO: Found listing with ID: US78573
2026-03-29 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US78573%27 HTTP/1.1" 200 None
2026-03-29 10:39:09 [auto1.de] INFO: Scrape type for US78573: 0
2026-03-29 10:39:09 [auto1.de] INFO: Found listing with ID: JB50627
2026-03-29 10:39:09 [auto1.de] INFO: Found listing with ID: TR13409
2026-03-29 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR13409%27 HTTP/1.1" 200 None
2026-03-29 10:39:09 [auto1.de] INFO: Scrape type for TR13409: 0
2026-03-29 10:39:09 [auto1.de] INFO: Found listing with ID: NL93445
2026-03-29 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL93445%27 HTTP/1.1" 200 None
2026-03-29 10:39:09 [auto1.de] INFO: Scrape type for NL93445: 0
2026-03-29 10:39:09 [auto1.de] INFO: Found listing with ID: HR10562
2026-03-29 10:39:09 [auto1.de] INFO: Found listing with ID: ST57334
2026-03-29 10:39:09 [auto1.de] INFO: Found listing with ID: CA38480
2026-03-29 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA38480%27 HTTP/1.1" 200 None
2026-03-29 10:39:09 [auto1.de] INFO: Scrape type for CA38480: 0
2026-03-29 10:39:09 [auto1.de] INFO: Found listing with ID: VK62428
2026-03-29 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK62428%27 HTTP/1.1" 200 None
2026-03-29 10:39:09 [auto1.de] INFO: Scrape type for VK62428: 0
2026-03-29 10:39:09 [auto1.de] INFO: Found listing with ID: SF39323
2026-03-29 10:39:09 [auto1.de] INFO: Found listing with ID: ZS55646
2026-03-29 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS55646%27 HTTP/1.1" 200 None
2026-03-29 10:39:09 [auto1.de] INFO: Scrape type for ZS55646: 0
2026-03-29 10:39:09 [auto1.de] INFO: Found listing with ID: MD70157
2026-03-29 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD70157%27 HTTP/1.1" 200 None
2026-03-29 10:39:09 [auto1.de] INFO: Scrape type for MD70157: 0
2026-03-29 10:39:09 [auto1.de] INFO: Found listing with ID: UT32036
2026-03-29 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT32036%27 HTTP/1.1" 200 None
2026-03-29 10:39:10 [auto1.de] INFO: Scrape type for UT32036: 0
2026-03-29 10:39:10 [auto1.de] INFO: Found listing with ID: UF29194
2026-03-29 10:39:10 [auto1.de] INFO: Found listing with ID: RN12872
2026-03-29 10:39:10 [auto1.de] INFO: Found listing with ID: XM14327
2026-03-29 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM14327%27 HTTP/1.1" 200 None
2026-03-29 10:39:10 [auto1.de] INFO: Scrape type for XM14327: 0
2026-03-29 10:39:10 [auto1.de] INFO: Found listing with ID: UF88550
2026-03-29 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF88550%27 HTTP/1.1" 200 None
2026-03-29 10:39:10 [auto1.de] INFO: Scrape type for UF88550: 0
2026-03-29 10:39:10 [auto1.de] INFO: Found listing with ID: NP24686
2026-03-29 10:39:10 [auto1.de] INFO: Found listing with ID: KH20562
2026-03-29 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH20562%27 HTTP/1.1" 200 None
2026-03-29 10:39:10 [auto1.de] INFO: Scrape type for KH20562: 0
2026-03-29 10:39:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:11 [auto1.de] INFO: Channel: 24h | Page: 62 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: NR67134
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: AA40394
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: WM90118
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: CD45301
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: JJ90967
2026-03-29 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ90967%27 HTTP/1.1" 200 None
2026-03-29 10:39:11 [auto1.de] INFO: Scrape type for JJ90967: 0
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: ND67175
2026-03-29 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND67175%27 HTTP/1.1" 200 None
2026-03-29 10:39:11 [auto1.de] INFO: Scrape type for ND67175: 0
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: WD77905
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: FG01299
2026-03-29 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG01299%27 HTTP/1.1" 200 None
2026-03-29 10:39:11 [auto1.de] INFO: Scrape type for FG01299: 0
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: XN62659
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: CK58457
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: AM35234
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: XD50788
2026-03-29 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD50788%27 HTTP/1.1" 200 None
2026-03-29 10:39:11 [auto1.de] INFO: Scrape type for XD50788: 0
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: HW81308
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: FT64995
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: NY07773
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: TX03008
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: WX30438
2026-03-29 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX30438%27 HTTP/1.1" 200 None
2026-03-29 10:39:11 [auto1.de] INFO: Scrape type for WX30438: 0
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: ED91782
2026-03-29 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED91782%27 HTTP/1.1" 200 None
2026-03-29 10:39:11 [auto1.de] INFO: Scrape type for ED91782: 0
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: RJ76690
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: MC27977
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: AU22690
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: FE71372
2026-03-29 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE71372%27 HTTP/1.1" 200 None
2026-03-29 10:39:11 [auto1.de] INFO: Scrape type for FE71372: 0
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: SS51493
2026-03-29 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS51493%27 HTTP/1.1" 200 None
2026-03-29 10:39:11 [auto1.de] INFO: Scrape type for SS51493: 0
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: CC81369
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: DN57570
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: PD33755
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: RP88862
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: HJ04828
2026-03-29 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ04828%27 HTTP/1.1" 200 None
2026-03-29 10:39:11 [auto1.de] INFO: Scrape type for HJ04828: 0
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: HJ55484
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: WD73510
2026-03-29 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD73510%27 HTTP/1.1" 200 None
2026-03-29 10:39:11 [auto1.de] INFO: Scrape type for WD73510: 0
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: KU56526
2026-03-29 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU56526%27 HTTP/1.1" 200 None
2026-03-29 10:39:11 [auto1.de] INFO: Scrape type for KU56526: 0
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: BK33721
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: ZN05925
2026-03-29 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN05925%27 HTTP/1.1" 200 None
2026-03-29 10:39:11 [auto1.de] INFO: Scrape type for ZN05925: 0
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: ZT00838
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: JJ29192
2026-03-29 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ29192%27 HTTP/1.1" 200 None
2026-03-29 10:39:11 [auto1.de] INFO: Scrape type for JJ29192: 0
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: PH25486
2026-03-29 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH25486%27 HTTP/1.1" 200 None
2026-03-29 10:39:11 [auto1.de] INFO: Scrape type for PH25486: 0
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: GC03067
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: UR03591
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: WX13584
2026-03-29 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX13584%27 HTTP/1.1" 200 None
2026-03-29 10:39:11 [auto1.de] INFO: Scrape type for WX13584: 0
2026-03-29 10:39:11 [auto1.de] INFO: Found listing with ID: LW48006
2026-03-29 10:39:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:12 [auto1.de] INFO: Channel: 24h | Page: 63 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:12 [auto1.de] INFO: Found listing with ID: EY00431
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY00431%27 HTTP/1.1" 200 None
2026-03-29 10:39:12 [auto1.de] INFO: Scrape type for EY00431: 0
2026-03-29 10:39:12 [auto1.de] INFO: Found listing with ID: HY60596
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY60596%27 HTTP/1.1" 200 None
2026-03-29 10:39:12 [auto1.de] INFO: Scrape type for HY60596: 0
2026-03-29 10:39:12 [auto1.de] INFO: Found listing with ID: PB35846
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB35846%27 HTTP/1.1" 200 None
2026-03-29 10:39:12 [auto1.de] INFO: Scrape type for PB35846: 0
2026-03-29 10:39:12 [auto1.de] INFO: Found listing with ID: RZ14311
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ14311%27 HTTP/1.1" 200 None
2026-03-29 10:39:12 [auto1.de] INFO: Scrape type for RZ14311: 0
2026-03-29 10:39:12 [auto1.de] INFO: Found listing with ID: YS55163
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS55163%27 HTTP/1.1" 200 None
2026-03-29 10:39:12 [auto1.de] INFO: Scrape type for YS55163: 0
2026-03-29 10:39:12 [auto1.de] INFO: Found listing with ID: MU86214
2026-03-29 10:39:12 [auto1.de] INFO: Found listing with ID: HB08106
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB08106%27 HTTP/1.1" 200 None
2026-03-29 10:39:12 [auto1.de] INFO: Scrape type for HB08106: 0
2026-03-29 10:39:12 [auto1.de] INFO: Found listing with ID: VL45063
2026-03-29 10:39:12 [auto1.de] INFO: Found listing with ID: ZU40216
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU40216%27 HTTP/1.1" 200 None
2026-03-29 10:39:12 [auto1.de] INFO: Scrape type for ZU40216: 0
2026-03-29 10:39:12 [auto1.de] INFO: Found listing with ID: HE80125
2026-03-29 10:39:12 [auto1.de] INFO: Found listing with ID: MK68330
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK68330%27 HTTP/1.1" 200 None
2026-03-29 10:39:12 [auto1.de] INFO: Scrape type for MK68330: 0
2026-03-29 10:39:12 [auto1.de] INFO: Found listing with ID: BM76815
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM76815%27 HTTP/1.1" 200 None
2026-03-29 10:39:12 [auto1.de] INFO: Scrape type for BM76815: 0
2026-03-29 10:39:12 [auto1.de] INFO: Found listing with ID: DM70862
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM70862%27 HTTP/1.1" 200 None
2026-03-29 10:39:12 [auto1.de] INFO: Scrape type for DM70862: 0
2026-03-29 10:39:12 [auto1.de] INFO: Found listing with ID: FX88340
2026-03-29 10:39:12 [auto1.de] INFO: Found listing with ID: JD23896
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD23896%27 HTTP/1.1" 200 None
2026-03-29 10:39:12 [auto1.de] INFO: Scrape type for JD23896: 0
2026-03-29 10:39:12 [auto1.de] INFO: Found listing with ID: VE61397
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE61397%27 HTTP/1.1" 200 None
2026-03-29 10:39:12 [auto1.de] INFO: Scrape type for VE61397: 0
2026-03-29 10:39:12 [auto1.de] INFO: Found listing with ID: GW97412
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW97412%27 HTTP/1.1" 200 None
2026-03-29 10:39:12 [auto1.de] INFO: Scrape type for GW97412: 0
2026-03-29 10:39:12 [auto1.de] INFO: Found listing with ID: SZ45065
2026-03-29 10:39:12 [auto1.de] INFO: Found listing with ID: CA54240
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA54240%27 HTTP/1.1" 200 None
2026-03-29 10:39:12 [auto1.de] INFO: Scrape type for CA54240: 0
2026-03-29 10:39:12 [auto1.de] INFO: Found listing with ID: DF33717
2026-03-29 10:39:12 [auto1.de] INFO: Found listing with ID: RJ96114
2026-03-29 10:39:12 [auto1.de] INFO: Found listing with ID: XR18256
2026-03-29 10:39:12 [auto1.de] INFO: Found listing with ID: UV08426
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV08426%27 HTTP/1.1" 200 None
2026-03-29 10:39:12 [auto1.de] INFO: Scrape type for UV08426: 0
2026-03-29 10:39:12 [auto1.de] INFO: Found listing with ID: PA19754
2026-03-29 10:39:12 [auto1.de] INFO: Found listing with ID: MP68485
2026-03-29 10:39:12 [auto1.de] INFO: Found listing with ID: VU97666
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU97666%27 HTTP/1.1" 200 None
2026-03-29 10:39:12 [auto1.de] INFO: Scrape type for VU97666: 0
2026-03-29 10:39:12 [auto1.de] INFO: Found listing with ID: ZU43350
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU43350%27 HTTP/1.1" 200 None
2026-03-29 10:39:12 [auto1.de] INFO: Scrape type for ZU43350: 0
2026-03-29 10:39:12 [auto1.de] INFO: Found listing with ID: WV10952
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV10952%27 HTTP/1.1" 200 None
2026-03-29 10:39:12 [auto1.de] INFO: Scrape type for WV10952: 0
2026-03-29 10:39:12 [auto1.de] INFO: Found listing with ID: ZN40502
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN40502%27 HTTP/1.1" 200 None
2026-03-29 10:39:12 [auto1.de] INFO: Scrape type for ZN40502: 2
2026-03-29 10:39:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5a357f5-4c18-50f0-82c9-55ba71e1afe7 with identifier: ZN40502
2026-03-29 10:39:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5a357f5-4c18-50f0-82c9-55ba71e1afe7 with scrape type 2
2026-03-29 10:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5a357f5-4c18-50f0-82c9-55ba71e1afe7 with scrape type 2
2026-03-29 10:39:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5a357f5-4c18-50f0-82c9-55ba71e1afe7, identifier: ZN40502
2026-03-29 10:39:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5a357f5-4c18-50f0-82c9-55ba71e1afe7 with identifier: ZN40502
2026-03-29 10:39:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5a357f5-4c18-50f0-82c9-55ba71e1afe7 with identifier: ZN40502
2026-03-29 10:39:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5a357f5-4c18-50f0-82c9-55ba71e1afe7 with identifier: ZN40502 to the API
2026-03-29 10:39:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:39:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:39:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:35:19Z',
 'fuel_type': 'petrol',
 'id': 'f5a357f5-4c18-50f0-82c9-55ba71e1afe7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN40502',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 149528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-07',
 'seller_name': None,
 'title': 'Dacia Sandero 1.2 Access',
 'transmission': 'manual',
 'trim': 'Access',
 'year': 2015}
2026-03-29 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN40502%27 HTTP/1.1" 200 None
2026-03-29 10:39:13 [auto1.de] INFO: Saving data for ZN40502: {'auction_closing_time': 1774884919.0, 'created_time': 1773646560.606247, 'last_price_update_time': 1774780753.427402}
2026-03-29 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN40502') HTTP/1.1" 204 0
2026-03-29 10:39:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:13 [auto1.de] INFO: Found listing with ID: SS28030
2026-03-29 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS28030%27 HTTP/1.1" 200 None
2026-03-29 10:39:13 [auto1.de] INFO: Scrape type for SS28030: 0
2026-03-29 10:39:13 [auto1.de] INFO: Found listing with ID: RW04069
2026-03-29 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW04069%27 HTTP/1.1" 200 None
2026-03-29 10:39:13 [auto1.de] INFO: Scrape type for RW04069: 0
2026-03-29 10:39:13 [auto1.de] INFO: Found listing with ID: VD78060
2026-03-29 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD78060%27 HTTP/1.1" 200 None
2026-03-29 10:39:13 [auto1.de] INFO: Scrape type for VD78060: 0
2026-03-29 10:39:13 [auto1.de] INFO: Found listing with ID: SS51107
2026-03-29 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS51107%27 HTTP/1.1" 200 None
2026-03-29 10:39:13 [auto1.de] INFO: Scrape type for SS51107: 0
2026-03-29 10:39:13 [auto1.de] INFO: Found listing with ID: ZZ43768
2026-03-29 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ43768%27 HTTP/1.1" 200 None
2026-03-29 10:39:13 [auto1.de] INFO: Scrape type for ZZ43768: 0
2026-03-29 10:39:13 [auto1.de] INFO: Found listing with ID: PE27590
2026-03-29 10:39:13 [auto1.de] INFO: Found listing with ID: CS04042
2026-03-29 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS04042%27 HTTP/1.1" 200 None
2026-03-29 10:39:13 [auto1.de] INFO: Scrape type for CS04042: 0
2026-03-29 10:39:13 [auto1.de] INFO: Found listing with ID: FH89031
2026-03-29 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH89031%27 HTTP/1.1" 200 None
2026-03-29 10:39:13 [auto1.de] INFO: Scrape type for FH89031: 0
2026-03-29 10:39:13 [auto1.de] INFO: Found listing with ID: YG21382
2026-03-29 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG21382%27 HTTP/1.1" 200 None
2026-03-29 10:39:13 [auto1.de] INFO: Scrape type for YG21382: 0
2026-03-29 10:39:13 [auto1.de] INFO: Found listing with ID: YU03537
2026-03-29 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU03537%27 HTTP/1.1" 200 None
2026-03-29 10:39:13 [auto1.de] INFO: Scrape type for YU03537: 0
2026-03-29 10:39:13 [auto1.de] INFO: Found listing with ID: JE48122
2026-03-29 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE48122%27 HTTP/1.1" 200 None
2026-03-29 10:39:13 [auto1.de] INFO: Scrape type for JE48122: 0
2026-03-29 10:39:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:14 [auto1.de] INFO: Channel: 24h | Page: 64 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: BZ53185
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: LW69749
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW69749%27 HTTP/1.1" 200 None
2026-03-29 10:39:14 [auto1.de] INFO: Scrape type for LW69749: 0
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: SC19815
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC19815%27 HTTP/1.1" 200 None
2026-03-29 10:39:14 [auto1.de] INFO: Scrape type for SC19815: 0
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: KR34750
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: DJ77655
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ77655%27 HTTP/1.1" 200 None
2026-03-29 10:39:14 [auto1.de] INFO: Scrape type for DJ77655: 0
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: ZK43120
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK43120%27 HTTP/1.1" 200 None
2026-03-29 10:39:14 [auto1.de] INFO: Scrape type for ZK43120: 0
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: AJ78717
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ78717%27 HTTP/1.1" 200 None
2026-03-29 10:39:14 [auto1.de] INFO: Scrape type for AJ78717: 0
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: BF31444
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF31444%27 HTTP/1.1" 200 None
2026-03-29 10:39:14 [auto1.de] INFO: Scrape type for BF31444: 0
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: DG35961
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG35961%27 HTTP/1.1" 200 None
2026-03-29 10:39:14 [auto1.de] INFO: Scrape type for DG35961: 0
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: EU51889
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU51889%27 HTTP/1.1" 200 None
2026-03-29 10:39:14 [auto1.de] INFO: Scrape type for EU51889: 0
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: SD83034
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD83034%27 HTTP/1.1" 200 None
2026-03-29 10:39:14 [auto1.de] INFO: Scrape type for SD83034: 0
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: FC40686
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: US02373
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: WK90635
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: EG76856
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG76856%27 HTTP/1.1" 200 None
2026-03-29 10:39:14 [auto1.de] INFO: Scrape type for EG76856: 0
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: SY84491
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY84491%27 HTTP/1.1" 200 None
2026-03-29 10:39:14 [auto1.de] INFO: Scrape type for SY84491: 0
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: DR94699
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR94699%27 HTTP/1.1" 200 None
2026-03-29 10:39:14 [auto1.de] INFO: Scrape type for DR94699: 0
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: CT65842
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT65842%27 HTTP/1.1" 200 None
2026-03-29 10:39:14 [auto1.de] INFO: Scrape type for CT65842: 0
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: TP63692
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP63692%27 HTTP/1.1" 200 None
2026-03-29 10:39:14 [auto1.de] INFO: Scrape type for TP63692: 0
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: XY67074
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: ZW22458
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: XT00440
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: EK13927
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK13927%27 HTTP/1.1" 200 None
2026-03-29 10:39:14 [auto1.de] INFO: Scrape type for EK13927: 0
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: TA01752
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA01752%27 HTTP/1.1" 200 None
2026-03-29 10:39:14 [auto1.de] INFO: Scrape type for TA01752: 0
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: CR38354
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR38354%27 HTTP/1.1" 200 None
2026-03-29 10:39:14 [auto1.de] INFO: Scrape type for CR38354: 0
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: DP85983
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: KA95549
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: GH07682
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH07682%27 HTTP/1.1" 200 None
2026-03-29 10:39:14 [auto1.de] INFO: Scrape type for GH07682: 0
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: DL51973
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: CG27437
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: WC28097
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC28097%27 HTTP/1.1" 200 None
2026-03-29 10:39:14 [auto1.de] INFO: Scrape type for WC28097: 0
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: WB32004
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB32004%27 HTTP/1.1" 200 None
2026-03-29 10:39:14 [auto1.de] INFO: Scrape type for WB32004: 0
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: FW13122
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: YY97428
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY97428%27 HTTP/1.1" 200 None
2026-03-29 10:39:14 [auto1.de] INFO: Scrape type for YY97428: 0
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: UE91712
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: SW23111
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: RM91715
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: VJ30367
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: EM80186
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM80186%27 HTTP/1.1" 200 None
2026-03-29 10:39:14 [auto1.de] INFO: Scrape type for EM80186: 0
2026-03-29 10:39:14 [auto1.de] INFO: Found listing with ID: BC27569
2026-03-29 10:39:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:16 [auto1.de] INFO: Channel: 24h | Page: 65 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: HT11802
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT11802%27 HTTP/1.1" 200 None
2026-03-29 10:39:16 [auto1.de] INFO: Scrape type for HT11802: 0
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: JT94626
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: DB09685
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB09685%27 HTTP/1.1" 200 None
2026-03-29 10:39:16 [auto1.de] INFO: Scrape type for DB09685: 0
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: HX36326
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX36326%27 HTTP/1.1" 200 None
2026-03-29 10:39:16 [auto1.de] INFO: Scrape type for HX36326: 0
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: SY11611
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY11611%27 HTTP/1.1" 200 None
2026-03-29 10:39:16 [auto1.de] INFO: Scrape type for SY11611: 0
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: NE16717
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE16717%27 HTTP/1.1" 200 None
2026-03-29 10:39:16 [auto1.de] INFO: Scrape type for NE16717: 0
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: ZW76685
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW76685%27 HTTP/1.1" 200 None
2026-03-29 10:39:16 [auto1.de] INFO: Scrape type for ZW76685: 0
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: KS86006
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: ZT22955
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT22955%27 HTTP/1.1" 200 None
2026-03-29 10:39:16 [auto1.de] INFO: Scrape type for ZT22955: 0
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: MH82914
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: ML35786
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML35786%27 HTTP/1.1" 200 None
2026-03-29 10:39:16 [auto1.de] INFO: Scrape type for ML35786: 0
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: UZ08427
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: BC06699
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC06699%27 HTTP/1.1" 200 None
2026-03-29 10:39:16 [auto1.de] INFO: Scrape type for BC06699: 0
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: YG74367
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG74367%27 HTTP/1.1" 200 None
2026-03-29 10:39:16 [auto1.de] INFO: Scrape type for YG74367: 0
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: BX62437
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX62437%27 HTTP/1.1" 200 None
2026-03-29 10:39:16 [auto1.de] INFO: Scrape type for BX62437: 0
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: XX92411
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX92411%27 HTTP/1.1" 200 None
2026-03-29 10:39:16 [auto1.de] INFO: Scrape type for XX92411: 0
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: TW39351
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW39351%27 HTTP/1.1" 200 None
2026-03-29 10:39:16 [auto1.de] INFO: Scrape type for TW39351: 0
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: BF60599
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: YG83893
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: WJ12441
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: EA07160
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA07160%27 HTTP/1.1" 200 None
2026-03-29 10:39:16 [auto1.de] INFO: Scrape type for EA07160: 0
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: VN06555
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN06555%27 HTTP/1.1" 200 None
2026-03-29 10:39:16 [auto1.de] INFO: Scrape type for VN06555: 0
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: MY48051
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY48051%27 HTTP/1.1" 200 None
2026-03-29 10:39:16 [auto1.de] INFO: Scrape type for MY48051: 0
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: UC14298
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC14298%27 HTTP/1.1" 200 None
2026-03-29 10:39:16 [auto1.de] INFO: Scrape type for UC14298: 0
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: DJ76178
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ76178%27 HTTP/1.1" 200 None
2026-03-29 10:39:16 [auto1.de] INFO: Scrape type for DJ76178: 0
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: NS82829
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: FJ78048
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ78048%27 HTTP/1.1" 200 None
2026-03-29 10:39:16 [auto1.de] INFO: Scrape type for FJ78048: 0
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: EN23227
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: DN49518
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: FZ02201
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ02201%27 HTTP/1.1" 200 None
2026-03-29 10:39:16 [auto1.de] INFO: Scrape type for FZ02201: 0
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: NN41224
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN41224%27 HTTP/1.1" 200 None
2026-03-29 10:39:16 [auto1.de] INFO: Scrape type for NN41224: 0
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: US46384
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: JB03726
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB03726%27 HTTP/1.1" 200 None
2026-03-29 10:39:16 [auto1.de] INFO: Scrape type for JB03726: 0
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: BZ42354
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ42354%27 HTTP/1.1" 200 None
2026-03-29 10:39:16 [auto1.de] INFO: Scrape type for BZ42354: 0
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: UA59883
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA59883%27 HTTP/1.1" 200 None
2026-03-29 10:39:16 [auto1.de] INFO: Scrape type for UA59883: 0
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: PU11267
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU11267%27 HTTP/1.1" 200 None
2026-03-29 10:39:16 [auto1.de] INFO: Scrape type for PU11267: 0
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: EL79145
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL79145%27 HTTP/1.1" 200 None
2026-03-29 10:39:16 [auto1.de] INFO: Scrape type for EL79145: 0
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: XB85584
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: RA04600
2026-03-29 10:39:16 [auto1.de] INFO: Found listing with ID: JG55591
2026-03-29 10:39:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:17 [auto1.de] INFO: Channel: 24h | Page: 66 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: AM22108
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM22108%27 HTTP/1.1" 200 None
2026-03-29 10:39:17 [auto1.de] INFO: Scrape type for AM22108: 0
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: BN16879
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: FU95957
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU95957%27 HTTP/1.1" 200 None
2026-03-29 10:39:17 [auto1.de] INFO: Scrape type for FU95957: 0
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: PJ55553
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: WR53064
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: AG88480
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG88480%27 HTTP/1.1" 200 None
2026-03-29 10:39:17 [auto1.de] INFO: Scrape type for AG88480: 0
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: YH66607
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: AV40802
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV40802%27 HTTP/1.1" 200 None
2026-03-29 10:39:17 [auto1.de] INFO: Scrape type for AV40802: 0
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: EU33293
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU33293%27 HTTP/1.1" 200 None
2026-03-29 10:39:17 [auto1.de] INFO: Scrape type for EU33293: 0
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: BB14997
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB14997%27 HTTP/1.1" 200 None
2026-03-29 10:39:17 [auto1.de] INFO: Scrape type for BB14997: 0
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: DY72609
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY72609%27 HTTP/1.1" 200 None
2026-03-29 10:39:17 [auto1.de] INFO: Scrape type for DY72609: 0
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: MC56654
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: VU29174
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: SN95717
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: BD12559
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: FF39586
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF39586%27 HTTP/1.1" 200 None
2026-03-29 10:39:17 [auto1.de] INFO: Scrape type for FF39586: 0
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: CY56514
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: RG61391
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG61391%27 HTTP/1.1" 200 None
2026-03-29 10:39:17 [auto1.de] INFO: Scrape type for RG61391: 0
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: DK43665
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: XA15787
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA15787%27 HTTP/1.1" 200 None
2026-03-29 10:39:17 [auto1.de] INFO: Scrape type for XA15787: 0
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: UY95441
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: SC10304
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: HZ88582
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: XX83628
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: XG58500
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG58500%27 HTTP/1.1" 200 None
2026-03-29 10:39:17 [auto1.de] INFO: Scrape type for XG58500: 0
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: US51436
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: KM67977
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM67977%27 HTTP/1.1" 200 None
2026-03-29 10:39:17 [auto1.de] INFO: Scrape type for KM67977: 0
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: PA77354
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA77354%27 HTTP/1.1" 200 None
2026-03-29 10:39:17 [auto1.de] INFO: Scrape type for PA77354: 0
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: DU13341
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: UT59305
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT59305%27 HTTP/1.1" 200 None
2026-03-29 10:39:17 [auto1.de] INFO: Scrape type for UT59305: 0
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: FP14792
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP14792%27 HTTP/1.1" 200 None
2026-03-29 10:39:17 [auto1.de] INFO: Scrape type for FP14792: 0
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: EJ47615
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ47615%27 HTTP/1.1" 200 None
2026-03-29 10:39:17 [auto1.de] INFO: Scrape type for EJ47615: 0
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: PG49368
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG49368%27 HTTP/1.1" 200 None
2026-03-29 10:39:17 [auto1.de] INFO: Scrape type for PG49368: 0
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: TY82930
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: EB22696
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: NC35007
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: YT04304
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: YB02361
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB02361%27 HTTP/1.1" 200 None
2026-03-29 10:39:17 [auto1.de] INFO: Scrape type for YB02361: 0
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: BB73401
2026-03-29 10:39:17 [auto1.de] INFO: Found listing with ID: SW44796
2026-03-29 10:39:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:18 [auto1.de] INFO: Channel: 24h | Page: 67 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:18 [auto1.de] INFO: Found listing with ID: PG96137
2026-03-29 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG96137%27 HTTP/1.1" 200 None
2026-03-29 10:39:18 [auto1.de] INFO: Scrape type for PG96137: 0
2026-03-29 10:39:18 [auto1.de] INFO: Found listing with ID: WP48150
2026-03-29 10:39:18 [auto1.de] INFO: Found listing with ID: XL13857
2026-03-29 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL13857%27 HTTP/1.1" 200 None
2026-03-29 10:39:18 [auto1.de] INFO: Scrape type for XL13857: 0
2026-03-29 10:39:18 [auto1.de] INFO: Found listing with ID: XM92815
2026-03-29 10:39:18 [auto1.de] INFO: Found listing with ID: GE16975
2026-03-29 10:39:18 [auto1.de] INFO: Found listing with ID: PN86617
2026-03-29 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN86617%27 HTTP/1.1" 200 None
2026-03-29 10:39:18 [auto1.de] INFO: Scrape type for PN86617: 0
2026-03-29 10:39:18 [auto1.de] INFO: Found listing with ID: KP27245
2026-03-29 10:39:18 [auto1.de] INFO: Found listing with ID: TJ39363
2026-03-29 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ39363%27 HTTP/1.1" 200 None
2026-03-29 10:39:18 [auto1.de] INFO: Scrape type for TJ39363: 0
2026-03-29 10:39:18 [auto1.de] INFO: Found listing with ID: CH25051
2026-03-29 10:39:18 [auto1.de] INFO: Found listing with ID: BA43321
2026-03-29 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA43321%27 HTTP/1.1" 200 None
2026-03-29 10:39:19 [auto1.de] INFO: Scrape type for BA43321: 0
2026-03-29 10:39:19 [auto1.de] INFO: Found listing with ID: MG32866
2026-03-29 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG32866%27 HTTP/1.1" 200 None
2026-03-29 10:39:19 [auto1.de] INFO: Scrape type for MG32866: 0
2026-03-29 10:39:19 [auto1.de] INFO: Found listing with ID: NY45710
2026-03-29 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY45710%27 HTTP/1.1" 200 None
2026-03-29 10:39:19 [auto1.de] INFO: Scrape type for NY45710: 0
2026-03-29 10:39:19 [auto1.de] INFO: Found listing with ID: VL21879
2026-03-29 10:39:19 [auto1.de] INFO: Found listing with ID: EW06930
2026-03-29 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW06930%27 HTTP/1.1" 200 None
2026-03-29 10:39:19 [auto1.de] INFO: Scrape type for EW06930: 0
2026-03-29 10:39:19 [auto1.de] INFO: Found listing with ID: RX49945
2026-03-29 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX49945%27 HTTP/1.1" 200 None
2026-03-29 10:39:19 [auto1.de] INFO: Scrape type for RX49945: 0
2026-03-29 10:39:19 [auto1.de] INFO: Found listing with ID: BK83629
2026-03-29 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK83629%27 HTTP/1.1" 200 None
2026-03-29 10:39:19 [auto1.de] INFO: Scrape type for BK83629: 0
2026-03-29 10:39:19 [auto1.de] INFO: Found listing with ID: LH67751
2026-03-29 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH67751%27 HTTP/1.1" 200 None
2026-03-29 10:39:19 [auto1.de] INFO: Scrape type for LH67751: 0
2026-03-29 10:39:19 [auto1.de] INFO: Found listing with ID: TS61714
2026-03-29 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS61714%27 HTTP/1.1" 200 None
2026-03-29 10:39:19 [auto1.de] INFO: Scrape type for TS61714: 0
2026-03-29 10:39:19 [auto1.de] INFO: Found listing with ID: FJ40863
2026-03-29 10:39:19 [auto1.de] INFO: Found listing with ID: UX44500
2026-03-29 10:39:19 [auto1.de] INFO: Found listing with ID: YM46431
2026-03-29 10:39:19 [auto1.de] INFO: Found listing with ID: DY93616
2026-03-29 10:39:19 [auto1.de] INFO: Found listing with ID: BG27909
2026-03-29 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG27909%27 HTTP/1.1" 200 None
2026-03-29 10:39:19 [auto1.de] INFO: Scrape type for BG27909: 0
2026-03-29 10:39:19 [auto1.de] INFO: Found listing with ID: BC55610
2026-03-29 10:39:19 [auto1.de] INFO: Found listing with ID: YH78241
2026-03-29 10:39:19 [auto1.de] INFO: Found listing with ID: XH00472
2026-03-29 10:39:19 [auto1.de] INFO: Found listing with ID: VH36335
2026-03-29 10:39:19 [auto1.de] INFO: Found listing with ID: EH98635
2026-03-29 10:39:19 [auto1.de] INFO: Found listing with ID: NC31400
2026-03-29 10:39:19 [auto1.de] INFO: Found listing with ID: HY54532
2026-03-29 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY54532%27 HTTP/1.1" 200 None
2026-03-29 10:39:19 [auto1.de] INFO: Scrape type for HY54532: 0
2026-03-29 10:39:19 [auto1.de] INFO: Found listing with ID: CK07133
2026-03-29 10:39:19 [auto1.de] INFO: Found listing with ID: YR31209
2026-03-29 10:39:19 [auto1.de] INFO: Found listing with ID: GC84828
2026-03-29 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC84828%27 HTTP/1.1" 200 None
2026-03-29 10:39:19 [auto1.de] INFO: Scrape type for GC84828: 0
2026-03-29 10:39:19 [auto1.de] INFO: Found listing with ID: SB04104
2026-03-29 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB04104%27 HTTP/1.1" 200 None
2026-03-29 10:39:19 [auto1.de] INFO: Scrape type for SB04104: 0
2026-03-29 10:39:19 [auto1.de] INFO: Found listing with ID: ZK30866
2026-03-29 10:39:19 [auto1.de] INFO: Found listing with ID: AY33433
2026-03-29 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY33433%27 HTTP/1.1" 200 None
2026-03-29 10:39:19 [auto1.de] INFO: Scrape type for AY33433: 0
2026-03-29 10:39:19 [auto1.de] INFO: Found listing with ID: AH65486
2026-03-29 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH65486%27 HTTP/1.1" 200 None
2026-03-29 10:39:19 [auto1.de] INFO: Scrape type for AH65486: 0
2026-03-29 10:39:19 [auto1.de] INFO: Found listing with ID: CN56098
2026-03-29 10:39:19 [auto1.de] INFO: Found listing with ID: GB85775
2026-03-29 10:39:19 [auto1.de] INFO: Found listing with ID: SA06109
2026-03-29 10:39:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:20 [auto1.de] INFO: Channel: 24h | Page: 68 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: TC39197
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC39197%27 HTTP/1.1" 200 None
2026-03-29 10:39:20 [auto1.de] INFO: Scrape type for TC39197: 0
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: VA96509
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: MH69826
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH69826%27 HTTP/1.1" 200 None
2026-03-29 10:39:20 [auto1.de] INFO: Scrape type for MH69826: 0
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: PX02497
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: LV46830
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: EU27466
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU27466%27 HTTP/1.1" 200 None
2026-03-29 10:39:20 [auto1.de] INFO: Scrape type for EU27466: 0
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: GG35295
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: HU76899
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: BC43890
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC43890%27 HTTP/1.1" 200 None
2026-03-29 10:39:20 [auto1.de] INFO: Scrape type for BC43890: 0
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: ZR48762
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR48762%27 HTTP/1.1" 200 None
2026-03-29 10:39:20 [auto1.de] INFO: Scrape type for ZR48762: 0
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: DZ70756
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ70756%27 HTTP/1.1" 200 None
2026-03-29 10:39:20 [auto1.de] INFO: Scrape type for DZ70756: 0
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: AU24928
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: KC98509
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC98509%27 HTTP/1.1" 200 None
2026-03-29 10:39:20 [auto1.de] INFO: Scrape type for KC98509: 0
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: NB74696
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: ZY67532
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY67532%27 HTTP/1.1" 200 None
2026-03-29 10:39:20 [auto1.de] INFO: Scrape type for ZY67532: 0
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: XM85964
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: EV07676
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: TT79830
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: DW20402
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: FY30353
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY30353%27 HTTP/1.1" 200 None
2026-03-29 10:39:20 [auto1.de] INFO: Scrape type for FY30353: 0
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: RN84486
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN84486%27 HTTP/1.1" 200 None
2026-03-29 10:39:20 [auto1.de] INFO: Scrape type for RN84486: 0
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: WR55651
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR55651%27 HTTP/1.1" 200 None
2026-03-29 10:39:20 [auto1.de] INFO: Scrape type for WR55651: 0
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: PZ64082
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ64082%27 HTTP/1.1" 200 None
2026-03-29 10:39:20 [auto1.de] INFO: Scrape type for PZ64082: 0
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: BJ76765
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: BS83474
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS83474%27 HTTP/1.1" 200 None
2026-03-29 10:39:20 [auto1.de] INFO: Scrape type for BS83474: 0
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: EB23649
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB23649%27 HTTP/1.1" 200 None
2026-03-29 10:39:20 [auto1.de] INFO: Scrape type for EB23649: 0
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: RU04475
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU04475%27 HTTP/1.1" 200 None
2026-03-29 10:39:20 [auto1.de] INFO: Scrape type for RU04475: 0
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: CM46932
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM46932%27 HTTP/1.1" 200 None
2026-03-29 10:39:20 [auto1.de] INFO: Scrape type for CM46932: 0
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: YU99321
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU99321%27 HTTP/1.1" 200 None
2026-03-29 10:39:20 [auto1.de] INFO: Scrape type for YU99321: 0
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: RJ05854
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: LZ09190
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: AU06034
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: BS30478
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS30478%27 HTTP/1.1" 200 None
2026-03-29 10:39:20 [auto1.de] INFO: Scrape type for BS30478: 0
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: GR11096
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR11096%27 HTTP/1.1" 200 None
2026-03-29 10:39:20 [auto1.de] INFO: Scrape type for GR11096: 0
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: LM64010
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: BU34226
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: VS98384
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS98384%27 HTTP/1.1" 200 None
2026-03-29 10:39:20 [auto1.de] INFO: Scrape type for VS98384: 0
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: BP69696
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP69696%27 HTTP/1.1" 200 None
2026-03-29 10:39:20 [auto1.de] INFO: Scrape type for BP69696: 0
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: UZ43090
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ43090%27 HTTP/1.1" 200 None
2026-03-29 10:39:20 [auto1.de] INFO: Scrape type for UZ43090: 0
2026-03-29 10:39:20 [auto1.de] INFO: Found listing with ID: LW30512
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW30512%27 HTTP/1.1" 200 None
2026-03-29 10:39:20 [auto1.de] INFO: Scrape type for LW30512: 0
2026-03-29 10:39:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:24 [auto1.de] INFO: Channel: 24h | Page: 69 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:24 [auto1.de] INFO: Found listing with ID: DB30141
2026-03-29 10:39:24 [auto1.de] INFO: Found listing with ID: CH30601
2026-03-29 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH30601%27 HTTP/1.1" 200 None
2026-03-29 10:39:24 [auto1.de] INFO: Scrape type for CH30601: 0
2026-03-29 10:39:24 [auto1.de] INFO: Found listing with ID: KG01306
2026-03-29 10:39:24 [auto1.de] INFO: Found listing with ID: GB27132
2026-03-29 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB27132%27 HTTP/1.1" 200 None
2026-03-29 10:39:24 [auto1.de] INFO: Scrape type for GB27132: 0
2026-03-29 10:39:24 [auto1.de] INFO: Found listing with ID: GW76676
2026-03-29 10:39:24 [auto1.de] INFO: Found listing with ID: JR98479
2026-03-29 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR98479%27 HTTP/1.1" 200 None
2026-03-29 10:39:24 [auto1.de] INFO: Scrape type for JR98479: 0
2026-03-29 10:39:24 [auto1.de] INFO: Found listing with ID: ZD70727
2026-03-29 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD70727%27 HTTP/1.1" 200 None
2026-03-29 10:39:24 [auto1.de] INFO: Scrape type for ZD70727: 0
2026-03-29 10:39:24 [auto1.de] INFO: Found listing with ID: RW15562
2026-03-29 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW15562%27 HTTP/1.1" 200 None
2026-03-29 10:39:24 [auto1.de] INFO: Scrape type for RW15562: 0
2026-03-29 10:39:24 [auto1.de] INFO: Found listing with ID: NZ56847
2026-03-29 10:39:24 [auto1.de] INFO: Found listing with ID: RX78889
2026-03-29 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX78889%27 HTTP/1.1" 200 None
2026-03-29 10:39:24 [auto1.de] INFO: Scrape type for RX78889: 0
2026-03-29 10:39:24 [auto1.de] INFO: Found listing with ID: FB42809
2026-03-29 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB42809%27 HTTP/1.1" 200 None
2026-03-29 10:39:24 [auto1.de] INFO: Scrape type for FB42809: 0
2026-03-29 10:39:24 [auto1.de] INFO: Found listing with ID: AV32823
2026-03-29 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV32823%27 HTTP/1.1" 200 None
2026-03-29 10:39:24 [auto1.de] INFO: Scrape type for AV32823: 0
2026-03-29 10:39:24 [auto1.de] INFO: Found listing with ID: VS80969
2026-03-29 10:39:24 [auto1.de] INFO: Found listing with ID: YT12990
2026-03-29 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT12990%27 HTTP/1.1" 200 None
2026-03-29 10:39:24 [auto1.de] INFO: Scrape type for YT12990: 0
2026-03-29 10:39:24 [auto1.de] INFO: Found listing with ID: DD28346
2026-03-29 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD28346%27 HTTP/1.1" 200 None
2026-03-29 10:39:24 [auto1.de] INFO: Scrape type for DD28346: 0
2026-03-29 10:39:24 [auto1.de] INFO: Found listing with ID: WU34060
2026-03-29 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU34060%27 HTTP/1.1" 200 None
2026-03-29 10:39:24 [auto1.de] INFO: Scrape type for WU34060: 0
2026-03-29 10:39:24 [auto1.de] INFO: Found listing with ID: MT59111
2026-03-29 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT59111%27 HTTP/1.1" 200 None
2026-03-29 10:39:24 [auto1.de] INFO: Scrape type for MT59111: 0
2026-03-29 10:39:24 [auto1.de] INFO: Found listing with ID: HV33102
2026-03-29 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV33102%27 HTTP/1.1" 200 None
2026-03-29 10:39:24 [auto1.de] INFO: Scrape type for HV33102: 0
2026-03-29 10:39:24 [auto1.de] INFO: Found listing with ID: GE37655
2026-03-29 10:39:24 [auto1.de] INFO: Found listing with ID: VX14305
2026-03-29 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX14305%27 HTTP/1.1" 200 None
2026-03-29 10:39:24 [auto1.de] INFO: Scrape type for VX14305: 0
2026-03-29 10:39:24 [auto1.de] INFO: Found listing with ID: LS36397
2026-03-29 10:39:24 [auto1.de] INFO: Found listing with ID: VZ15565
2026-03-29 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ15565%27 HTTP/1.1" 200 None
2026-03-29 10:39:25 [auto1.de] INFO: Scrape type for VZ15565: 0
2026-03-29 10:39:25 [auto1.de] INFO: Found listing with ID: PF67152
2026-03-29 10:39:25 [auto1.de] INFO: Found listing with ID: NV00892
2026-03-29 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV00892%27 HTTP/1.1" 200 None
2026-03-29 10:39:25 [auto1.de] INFO: Scrape type for NV00892: 0
2026-03-29 10:39:25 [auto1.de] INFO: Found listing with ID: CV84531
2026-03-29 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV84531%27 HTTP/1.1" 200 None
2026-03-29 10:39:25 [auto1.de] INFO: Scrape type for CV84531: 0
2026-03-29 10:39:25 [auto1.de] INFO: Found listing with ID: YT58518
2026-03-29 10:39:25 [auto1.de] INFO: Found listing with ID: YU69669
2026-03-29 10:39:25 [auto1.de] INFO: Found listing with ID: RN98053
2026-03-29 10:39:25 [auto1.de] INFO: Found listing with ID: CT73600
2026-03-29 10:39:25 [auto1.de] INFO: Found listing with ID: GX89038
2026-03-29 10:39:25 [auto1.de] INFO: Found listing with ID: CK72791
2026-03-29 10:39:25 [auto1.de] INFO: Found listing with ID: XR25495
2026-03-29 10:39:25 [auto1.de] INFO: Found listing with ID: MB36683
2026-03-29 10:39:25 [auto1.de] INFO: Found listing with ID: AK97582
2026-03-29 10:39:25 [auto1.de] INFO: Found listing with ID: KW79987
2026-03-29 10:39:25 [auto1.de] INFO: Found listing with ID: CM72901
2026-03-29 10:39:25 [auto1.de] INFO: Found listing with ID: UF17826
2026-03-29 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF17826%27 HTTP/1.1" 200 None
2026-03-29 10:39:25 [auto1.de] INFO: Scrape type for UF17826: 0
2026-03-29 10:39:25 [auto1.de] INFO: Found listing with ID: RY42515
2026-03-29 10:39:25 [auto1.de] INFO: Found listing with ID: BX09216
2026-03-29 10:39:25 [auto1.de] INFO: Found listing with ID: ZS44353
2026-03-29 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS44353%27 HTTP/1.1" 200 None
2026-03-29 10:39:25 [auto1.de] INFO: Scrape type for ZS44353: 0
2026-03-29 10:39:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:33 [auto1.de] INFO: Channel: 24h | Page: 70 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: ZY07029
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY07029%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for ZY07029: 0
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: KA83953
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA83953%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for KA83953: 0
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: SC48990
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: ZF45936
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: EV39961
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: NB97805
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB97805%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for NB97805: 0
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: XD89320
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD89320%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for XD89320: 0
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: XA52388
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA52388%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for XA52388: 0
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: MW62166
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: GK14526
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: AA38517
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA38517%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for AA38517: 0
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: BZ60217
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ60217%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for BZ60217: 0
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: TP70009
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: LN58071
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN58071%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for LN58071: 0
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: SC45462
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: VY10701
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: DJ74169
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: AF42457
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: DZ52896
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: BD46064
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD46064%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for BD46064: 0
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: AD28287
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: TN14580
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: FY25163
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: JP54184
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP54184%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for JP54184: 0
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: PY44699
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: NL59823
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: NG89372
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG89372%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for NG89372: 0
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: AW80903
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW80903%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for AW80903: 0
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: SC26693
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: FB84476
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB84476%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for FB84476: 0
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: GB74339
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: CK11382
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK11382%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for CK11382: 0
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: NG94369
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: VZ83010
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ83010%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for VZ83010: 0
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: AR53020
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: WY91699
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: VN54723
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN54723%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for VN54723: 0
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: HG94589
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: MC98877
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC98877%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for MC98877: 0
2026-03-29 10:39:33 [auto1.de] INFO: Found listing with ID: NH53597
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH53597%27 HTTP/1.1" 200 None
2026-03-29 10:39:33 [auto1.de] INFO: Scrape type for NH53597: 0
2026-03-29 10:39:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:35 [auto1.de] INFO: Channel: 24h | Page: 71 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:35 [auto1.de] INFO: Found listing with ID: PA91230
2026-03-29 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA91230%27 HTTP/1.1" 200 None
2026-03-29 10:39:35 [auto1.de] INFO: Scrape type for PA91230: 2
2026-03-29 10:39:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2e83648-ae68-5662-bf56-34c387ee1434 with identifier: PA91230
2026-03-29 10:39:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2e83648-ae68-5662-bf56-34c387ee1434 with scrape type 2
2026-03-29 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2e83648-ae68-5662-bf56-34c387ee1434 with scrape type 2
2026-03-29 10:39:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2e83648-ae68-5662-bf56-34c387ee1434, identifier: PA91230
2026-03-29 10:39:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2e83648-ae68-5662-bf56-34c387ee1434 with identifier: PA91230
2026-03-29 10:39:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2e83648-ae68-5662-bf56-34c387ee1434 with identifier: PA91230
2026-03-29 10:39:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2e83648-ae68-5662-bf56-34c387ee1434 with identifier: PA91230 to the API
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:39:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:36:38Z',
 'fuel_type': 'diesel',
 'id': 'e2e83648-ae68-5662-bf56-34c387ee1434',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA91230',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 100861,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-15',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2014}
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA91230%27 HTTP/1.1" 200 None
2026-03-29 10:39:36 [auto1.de] INFO: Saving data for PA91230: {'auction_closing_time': 1774884998.0, 'created_time': 1772725959.958995, 'last_price_update_time': 1774780776.329003}
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA91230') HTTP/1.1" 204 0
2026-03-29 10:39:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: LM89812
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: MC93517
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC93517%27 HTTP/1.1" 200 None
2026-03-29 10:39:36 [auto1.de] INFO: Scrape type for MC93517: 0
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: KM30220
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM30220%27 HTTP/1.1" 200 None
2026-03-29 10:39:36 [auto1.de] INFO: Scrape type for KM30220: 0
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: PA88457
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: NE52715
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: EP96455
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP96455%27 HTTP/1.1" 200 None
2026-03-29 10:39:36 [auto1.de] INFO: Scrape type for EP96455: 0
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: XN51512
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: LD06025
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: BB27376
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: XU64075
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: TL87064
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: BE80399
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE80399%27 HTTP/1.1" 200 None
2026-03-29 10:39:36 [auto1.de] INFO: Scrape type for BE80399: 0
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: YZ86105
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: BC65369
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC65369%27 HTTP/1.1" 200 None
2026-03-29 10:39:36 [auto1.de] INFO: Scrape type for BC65369: 0
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: AR55742
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: BK59777
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: VS51325
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS51325%27 HTTP/1.1" 200 None
2026-03-29 10:39:36 [auto1.de] INFO: Scrape type for VS51325: 0
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: HP91359
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: VF41212
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: CM37211
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM37211%27 HTTP/1.1" 200 None
2026-03-29 10:39:36 [auto1.de] INFO: Scrape type for CM37211: 0
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: AM68343
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM68343%27 HTTP/1.1" 200 None
2026-03-29 10:39:36 [auto1.de] INFO: Scrape type for AM68343: 0
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: SM38981
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM38981%27 HTTP/1.1" 200 None
2026-03-29 10:39:36 [auto1.de] INFO: Scrape type for SM38981: 0
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: HF06660
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: WD52714
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD52714%27 HTTP/1.1" 200 None
2026-03-29 10:39:36 [auto1.de] INFO: Scrape type for WD52714: 0
2026-03-29 10:39:36 [auto1.de] INFO: Found listing with ID: PS74193
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS74193%27 HTTP/1.1" 200 None
2026-03-29 10:39:36 [auto1.de] INFO: Scrape type for PS74193: 2
2026-03-29 10:39:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c911216f-2756-541d-8dfc-2e18f22bded4 with identifier: PS74193
2026-03-29 10:39:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c911216f-2756-541d-8dfc-2e18f22bded4 with scrape type 2
2026-03-29 10:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c911216f-2756-541d-8dfc-2e18f22bded4 with scrape type 2
2026-03-29 10:39:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c911216f-2756-541d-8dfc-2e18f22bded4, identifier: PS74193
2026-03-29 10:39:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c911216f-2756-541d-8dfc-2e18f22bded4 with identifier: PS74193
2026-03-29 10:39:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c911216f-2756-541d-8dfc-2e18f22bded4 with identifier: PS74193
2026-03-29 10:39:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c911216f-2756-541d-8dfc-2e18f22bded4 with identifier: PS74193 to the API
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:39:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:39:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 400,
 'expiration_date': '2026-03-30T15:21:28Z',
 'fuel_type': 'petrol',
 'id': 'c911216f-2756-541d-8dfc-2e18f22bded4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS74193',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Panamera',
 'odometer': 186600,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-26',
 'seller_name': None,
 'title': 'Porsche Panamera 4S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-29 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS74193%27 HTTP/1.1" 200 None
2026-03-29 10:39:37 [auto1.de] INFO: Saving data for PS74193: {'auction_closing_time': 1774884088.0, 'created_time': 1774035042.694787, 'last_price_update_time': 1774780777.080297}
2026-03-29 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS74193') HTTP/1.1" 204 0
2026-03-29 10:39:37 [auto1.de] INFO: Found listing with ID: JE50334
2026-03-29 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE50334%27 HTTP/1.1" 200 None
2026-03-29 10:39:37 [auto1.de] INFO: Scrape type for JE50334: 0
2026-03-29 10:39:37 [auto1.de] INFO: Found listing with ID: ZK10618
2026-03-29 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK10618%27 HTTP/1.1" 200 None
2026-03-29 10:39:37 [auto1.de] INFO: Scrape type for ZK10618: 0
2026-03-29 10:39:37 [auto1.de] INFO: Found listing with ID: WY19584
2026-03-29 10:39:37 [auto1.de] INFO: Found listing with ID: YA26169
2026-03-29 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA26169%27 HTTP/1.1" 200 None
2026-03-29 10:39:37 [auto1.de] INFO: Scrape type for YA26169: 0
2026-03-29 10:39:37 [auto1.de] INFO: Found listing with ID: CT00605
2026-03-29 10:39:37 [auto1.de] INFO: Found listing with ID: NX98723
2026-03-29 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX98723%27 HTTP/1.1" 200 None
2026-03-29 10:39:37 [auto1.de] INFO: Scrape type for NX98723: 0
2026-03-29 10:39:37 [auto1.de] INFO: Found listing with ID: DE97424
2026-03-29 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE97424%27 HTTP/1.1" 200 None
2026-03-29 10:39:37 [auto1.de] INFO: Scrape type for DE97424: 0
2026-03-29 10:39:37 [auto1.de] INFO: Found listing with ID: WG93130
2026-03-29 10:39:37 [auto1.de] INFO: Found listing with ID: VY28868
2026-03-29 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY28868%27 HTTP/1.1" 200 None
2026-03-29 10:39:37 [auto1.de] INFO: Scrape type for VY28868: 0
2026-03-29 10:39:37 [auto1.de] INFO: Found listing with ID: XN16480
2026-03-29 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN16480%27 HTTP/1.1" 200 None
2026-03-29 10:39:37 [auto1.de] INFO: Scrape type for XN16480: 0
2026-03-29 10:39:37 [auto1.de] INFO: Found listing with ID: EN50331
2026-03-29 10:39:37 [auto1.de] INFO: Found listing with ID: CD67065
2026-03-29 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD67065%27 HTTP/1.1" 200 None
2026-03-29 10:39:37 [auto1.de] INFO: Scrape type for CD67065: 0
2026-03-29 10:39:37 [auto1.de] INFO: Found listing with ID: PZ11168
2026-03-29 10:39:37 [auto1.de] INFO: Found listing with ID: WE44185
2026-03-29 10:39:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:38 [auto1.de] INFO: Channel: 24h | Page: 72 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: NF30454
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: ZG00412
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: UZ37067
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: EH58090
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH58090%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for EH58090: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: SL27608
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: SS59240
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS59240%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for SS59240: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: BW78905
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW78905%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for BW78905: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: JA27410
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: LV93529
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV93529%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for LV93529: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: LK46158
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK46158%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for LK46158: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: VR34423
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: FP27450
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP27450%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for FP27450: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: UZ18000
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: RV26500
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV26500%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for RV26500: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: UK70882
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: LB25198
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB25198%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for LB25198: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: DN02562
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN02562%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for DN02562: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: TV01596
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV01596%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for TV01596: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: SU94182
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU94182%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for SU94182: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: TJ83975
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ83975%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for TJ83975: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: MU97238
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU97238%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for MU97238: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: NA32054
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA32054%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for NA32054: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: YT16103
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT16103%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for YT16103: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: SK51641
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: SP10059
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: DW51780
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW51780%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for DW51780: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: VN46305
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: TJ16115
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: JK31212
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: BJ70582
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ70582%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for BJ70582: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: SM03586
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: MY29921
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: ZM08692
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: JB08013
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB08013%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for JB08013: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: RC44114
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC44114%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for RC44114: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: UN13511
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: GD61504
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: AE57502
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE57502%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for AE57502: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: HC05500
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC05500%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for HC05500: 0
2026-03-29 10:39:38 [auto1.de] INFO: Found listing with ID: KE06488
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE06488%27 HTTP/1.1" 200 None
2026-03-29 10:39:38 [auto1.de] INFO: Scrape type for KE06488: 0
2026-03-29 10:39:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:39 [auto1.de] INFO: Channel: 24h | Page: 73 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: RC86111
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: VR75394
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: GA86041
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA86041%27 HTTP/1.1" 200 None
2026-03-29 10:39:39 [auto1.de] INFO: Scrape type for GA86041: 0
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: XJ26035
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: SU61840
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU61840%27 HTTP/1.1" 200 None
2026-03-29 10:39:39 [auto1.de] INFO: Scrape type for SU61840: 0
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: GH26905
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: GP45415
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: CV30078
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV30078%27 HTTP/1.1" 200 None
2026-03-29 10:39:39 [auto1.de] INFO: Scrape type for CV30078: 0
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: BY91581
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY91581%27 HTTP/1.1" 200 None
2026-03-29 10:39:39 [auto1.de] INFO: Scrape type for BY91581: 0
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: RD90808
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD90808%27 HTTP/1.1" 200 None
2026-03-29 10:39:39 [auto1.de] INFO: Scrape type for RD90808: 0
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: FE22716
2026-03-29 10:39:39 [auto1.de] INFO: Found listing with ID: LR33805
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR33805%27 HTTP/1.1" 200 None
2026-03-29 10:39:39 [auto1.de] INFO: Scrape type for LR33805: 2
2026-03-29 10:39:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 594a4860-9eb1-537b-8539-49020243c248 with identifier: LR33805
2026-03-29 10:39:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 594a4860-9eb1-537b-8539-49020243c248 with scrape type 2
2026-03-29 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 594a4860-9eb1-537b-8539-49020243c248 with scrape type 2
2026-03-29 10:39:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 594a4860-9eb1-537b-8539-49020243c248, identifier: LR33805
2026-03-29 10:39:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 594a4860-9eb1-537b-8539-49020243c248 with identifier: LR33805
2026-03-29 10:39:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 594a4860-9eb1-537b-8539-49020243c248 with identifier: LR33805
2026-03-29 10:39:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 594a4860-9eb1-537b-8539-49020243c248 with identifier: LR33805 to the API
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:39:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:34:31Z',
 'fuel_type': 'diesel',
 'id': '594a4860-9eb1-537b-8539-49020243c248',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR33805',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 135638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-29',
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Exclusive-Line AWD',
 'transmission': 'manual',
 'trim': 'Exclusive-Line AWD',
 'year': 2016}
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR33805%27 HTTP/1.1" 200 None
2026-03-29 10:39:40 [auto1.de] INFO: Saving data for LR33805: {'auction_closing_time': 1774884871.0, 'created_time': 1774467939.741152, 'last_price_update_time': 1774780780.331544}
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR33805') HTTP/1.1" 204 0
2026-03-29 10:39:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: YN77653
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: GK55952
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK55952%27 HTTP/1.1" 200 None
2026-03-29 10:39:40 [auto1.de] INFO: Scrape type for GK55952: 0
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: ZU59417
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: CS57817
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: GY49475
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY49475%27 HTTP/1.1" 200 None
2026-03-29 10:39:40 [auto1.de] INFO: Scrape type for GY49475: 0
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: DK64287
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK64287%27 HTTP/1.1" 200 None
2026-03-29 10:39:40 [auto1.de] INFO: Scrape type for DK64287: 0
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: YT00833
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT00833%27 HTTP/1.1" 200 None
2026-03-29 10:39:40 [auto1.de] INFO: Scrape type for YT00833: 0
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: DD95746
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: PN07086
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: RV27706
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: ZK33939
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: KX83133
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX83133%27 HTTP/1.1" 200 None
2026-03-29 10:39:40 [auto1.de] INFO: Scrape type for KX83133: 0
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: SA17140
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: CG01662
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG01662%27 HTTP/1.1" 200 None
2026-03-29 10:39:40 [auto1.de] INFO: Scrape type for CG01662: 0
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: TZ90006
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ90006%27 HTTP/1.1" 200 None
2026-03-29 10:39:40 [auto1.de] INFO: Scrape type for TZ90006: 0
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: EA89472
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA89472%27 HTTP/1.1" 200 None
2026-03-29 10:39:40 [auto1.de] INFO: Scrape type for EA89472: 0
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: WY51014
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY51014%27 HTTP/1.1" 200 None
2026-03-29 10:39:40 [auto1.de] INFO: Scrape type for WY51014: 0
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: HE21190
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: US71241
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: CR70146
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR70146%27 HTTP/1.1" 200 None
2026-03-29 10:39:40 [auto1.de] INFO: Scrape type for CR70146: 0
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: PV05136
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV05136%27 HTTP/1.1" 200 None
2026-03-29 10:39:40 [auto1.de] INFO: Scrape type for PV05136: 0
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: ZF08436
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF08436%27 HTTP/1.1" 200 None
2026-03-29 10:39:40 [auto1.de] INFO: Scrape type for ZF08436: 0
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: MY97637
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: NB27251
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB27251%27 HTTP/1.1" 200 None
2026-03-29 10:39:40 [auto1.de] INFO: Scrape type for NB27251: 0
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: HR27692
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR27692%27 HTTP/1.1" 200 None
2026-03-29 10:39:40 [auto1.de] INFO: Scrape type for HR27692: 0
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: PN60983
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN60983%27 HTTP/1.1" 200 None
2026-03-29 10:39:40 [auto1.de] INFO: Scrape type for PN60983: 0
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: WC52225
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC52225%27 HTTP/1.1" 200 None
2026-03-29 10:39:40 [auto1.de] INFO: Scrape type for WC52225: 0
2026-03-29 10:39:40 [auto1.de] INFO: Found listing with ID: EW68189
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW68189%27 HTTP/1.1" 200 None
2026-03-29 10:39:40 [auto1.de] INFO: Scrape type for EW68189: 0
2026-03-29 10:39:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:41 [auto1.de] INFO: Channel: 24h | Page: 74 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: TT67708
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT67708%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for TT67708: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: YY49162
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: JR21224
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: TL68554
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL68554%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for TL68554: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: VU36521
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU36521%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for VU36521: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: EZ09435
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ09435%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for EZ09435: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: LN53329
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN53329%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for LN53329: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: GW17934
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW17934%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for GW17934: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: HG38928
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: JT99615
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: DF59303
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: UE69699
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE69699%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for UE69699: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: LK78678
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK78678%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for LK78678: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: HY74574
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY74574%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for HY74574: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: HD50866
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD50866%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for HD50866: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: KP72429
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP72429%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for KP72429: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: SN40806
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN40806%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for SN40806: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: VW56389
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: JY33610
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: HM04457
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: WZ14073
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ14073%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for WZ14073: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: EN90928
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: KG29776
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: RB29698
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: MU35402
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: BC48090
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC48090%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for BC48090: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: YV87591
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV87591%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for YV87591: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: ZV83127
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: VU37583
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU37583%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for VU37583: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: VS89065
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS89065%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for VS89065: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: CK79873
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: LH09734
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: KK06519
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK06519%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for KK06519: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: NT80809
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT80809%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for NT80809: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: CZ89661
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: HV64790
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV64790%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for HV64790: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: XL73598
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: YA77478
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: NF12247
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF12247%27 HTTP/1.1" 200 None
2026-03-29 10:39:41 [auto1.de] INFO: Scrape type for NF12247: 0
2026-03-29 10:39:41 [auto1.de] INFO: Found listing with ID: MW99572
2026-03-29 10:39:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:42 [auto1.de] INFO: Channel: 24h | Page: 75 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:42 [auto1.de] INFO: Found listing with ID: UU18213
2026-03-29 10:39:42 [auto1.de] INFO: Found listing with ID: ZY56723
2026-03-29 10:39:42 [auto1.de] INFO: Found listing with ID: MK79183
2026-03-29 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK79183%27 HTTP/1.1" 200 None
2026-03-29 10:39:42 [auto1.de] INFO: Scrape type for MK79183: 0
2026-03-29 10:39:42 [auto1.de] INFO: Found listing with ID: HJ94843
2026-03-29 10:39:42 [auto1.de] INFO: Found listing with ID: LR85001
2026-03-29 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR85001%27 HTTP/1.1" 200 None
2026-03-29 10:39:42 [auto1.de] INFO: Scrape type for LR85001: 0
2026-03-29 10:39:42 [auto1.de] INFO: Found listing with ID: BW33957
2026-03-29 10:39:42 [auto1.de] INFO: Found listing with ID: TW44182
2026-03-29 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW44182%27 HTTP/1.1" 200 None
2026-03-29 10:39:42 [auto1.de] INFO: Scrape type for TW44182: 0
2026-03-29 10:39:42 [auto1.de] INFO: Found listing with ID: BW06665
2026-03-29 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW06665%27 HTTP/1.1" 200 None
2026-03-29 10:39:43 [auto1.de] INFO: Scrape type for BW06665: 0
2026-03-29 10:39:43 [auto1.de] INFO: Found listing with ID: RJ71204
2026-03-29 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ71204%27 HTTP/1.1" 200 None
2026-03-29 10:39:43 [auto1.de] INFO: Scrape type for RJ71204: 0
2026-03-29 10:39:43 [auto1.de] INFO: Found listing with ID: ZU42459
2026-03-29 10:39:43 [auto1.de] INFO: Found listing with ID: RK85869
2026-03-29 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK85869%27 HTTP/1.1" 200 None
2026-03-29 10:39:43 [auto1.de] INFO: Scrape type for RK85869: 0
2026-03-29 10:39:43 [auto1.de] INFO: Found listing with ID: ZH34670
2026-03-29 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH34670%27 HTTP/1.1" 200 None
2026-03-29 10:39:43 [auto1.de] INFO: Scrape type for ZH34670: 0
2026-03-29 10:39:43 [auto1.de] INFO: Found listing with ID: BE15343
2026-03-29 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE15343%27 HTTP/1.1" 200 None
2026-03-29 10:39:43 [auto1.de] INFO: Scrape type for BE15343: 0
2026-03-29 10:39:43 [auto1.de] INFO: Found listing with ID: YD60070
2026-03-29 10:39:43 [auto1.de] INFO: Found listing with ID: CA27289
2026-03-29 10:39:43 [auto1.de] INFO: Found listing with ID: ZF67159
2026-03-29 10:39:43 [auto1.de] INFO: Found listing with ID: CW80278
2026-03-29 10:39:43 [auto1.de] INFO: Found listing with ID: WD35847
2026-03-29 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD35847%27 HTTP/1.1" 200 None
2026-03-29 10:39:43 [auto1.de] INFO: Scrape type for WD35847: 0
2026-03-29 10:39:43 [auto1.de] INFO: Found listing with ID: EN88282
2026-03-29 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN88282%27 HTTP/1.1" 200 None
2026-03-29 10:39:43 [auto1.de] INFO: Scrape type for EN88282: 0
2026-03-29 10:39:43 [auto1.de] INFO: Found listing with ID: WP47747
2026-03-29 10:39:43 [auto1.de] INFO: Found listing with ID: ZY80421
2026-03-29 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY80421%27 HTTP/1.1" 200 None
2026-03-29 10:39:43 [auto1.de] INFO: Scrape type for ZY80421: 0
2026-03-29 10:39:43 [auto1.de] INFO: Found listing with ID: PU85783
2026-03-29 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU85783%27 HTTP/1.1" 200 None
2026-03-29 10:39:43 [auto1.de] INFO: Scrape type for PU85783: 0
2026-03-29 10:39:43 [auto1.de] INFO: Found listing with ID: MS83797
2026-03-29 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS83797%27 HTTP/1.1" 200 None
2026-03-29 10:39:43 [auto1.de] INFO: Scrape type for MS83797: 0
2026-03-29 10:39:43 [auto1.de] INFO: Found listing with ID: LW43520
2026-03-29 10:39:43 [auto1.de] INFO: Found listing with ID: XK33490
2026-03-29 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK33490%27 HTTP/1.1" 200 None
2026-03-29 10:39:43 [auto1.de] INFO: Scrape type for XK33490: 0
2026-03-29 10:39:43 [auto1.de] INFO: Found listing with ID: JD54519
2026-03-29 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD54519%27 HTTP/1.1" 200 None
2026-03-29 10:39:43 [auto1.de] INFO: Scrape type for JD54519: 0
2026-03-29 10:39:43 [auto1.de] INFO: Found listing with ID: WR99181
2026-03-29 10:39:43 [auto1.de] INFO: Found listing with ID: XD58993
2026-03-29 10:39:43 [auto1.de] INFO: Found listing with ID: KS42383
2026-03-29 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS42383%27 HTTP/1.1" 200 None
2026-03-29 10:39:43 [auto1.de] INFO: Scrape type for KS42383: 0
2026-03-29 10:39:43 [auto1.de] INFO: Found listing with ID: ME12043
2026-03-29 10:39:43 [auto1.de] INFO: Found listing with ID: YB86536
2026-03-29 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB86536%27 HTTP/1.1" 200 None
2026-03-29 10:39:43 [auto1.de] INFO: Scrape type for YB86536: 0
2026-03-29 10:39:43 [auto1.de] INFO: Found listing with ID: FG75722
2026-03-29 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG75722%27 HTTP/1.1" 200 None
2026-03-29 10:39:43 [auto1.de] INFO: Scrape type for FG75722: 0
2026-03-29 10:39:43 [auto1.de] INFO: Found listing with ID: SD97280
2026-03-29 10:39:43 [auto1.de] INFO: Found listing with ID: LG84508
2026-03-29 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG84508%27 HTTP/1.1" 200 None
2026-03-29 10:39:43 [auto1.de] INFO: Scrape type for LG84508: 0
2026-03-29 10:39:43 [auto1.de] INFO: Found listing with ID: BP02747
2026-03-29 10:39:43 [auto1.de] INFO: Found listing with ID: BT37883
2026-03-29 10:39:43 [auto1.de] INFO: Found listing with ID: ST29936
2026-03-29 10:39:43 [auto1.de] INFO: Found listing with ID: RX04560
2026-03-29 10:39:43 [auto1.de] INFO: Found listing with ID: YZ54178
2026-03-29 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ54178%27 HTTP/1.1" 200 None
2026-03-29 10:39:43 [auto1.de] INFO: Scrape type for YZ54178: 0
2026-03-29 10:39:43 [auto1.de] INFO: Found listing with ID: UW12612
2026-03-29 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW12612%27 HTTP/1.1" 200 None
2026-03-29 10:39:43 [auto1.de] INFO: Scrape type for UW12612: 0
2026-03-29 10:39:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:44 [auto1.de] INFO: Channel: 24h | Page: 76 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: VW79588
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: AJ43779
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ43779%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for AJ43779: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: FV26342
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: DX03120
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: UV59464
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: NR35132
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR35132%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for NR35132: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: GS49465
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: KE42269
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE42269%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for KE42269: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: AC77037
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC77037%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for AC77037: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: LT68556
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT68556%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for LT68556: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: NS17757
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS17757%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for NS17757: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: PA20304
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA20304%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for PA20304: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: RF69391
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF69391%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for RF69391: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: HF35410
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: NS53664
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: TU97792
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: GY67479
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: MA44978
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: VG52113
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: LL99453
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL99453%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for LL99453: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: HZ51579
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: YT13980
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT13980%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for YT13980: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: GV20028
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV20028%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for GV20028: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: SM28331
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM28331%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for SM28331: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: CX62190
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: VJ08081
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: WK73698
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: RE06888
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: XJ33844
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ33844%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for XJ33844: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: EE83038
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: XY66672
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY66672%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for XY66672: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: NX72393
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: HE92439
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: TP66547
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP66547%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for TP66547: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: MM36361
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: SH26484
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: VP25295
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP25295%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for VP25295: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: BK52975
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK52975%27 HTTP/1.1" 200 None
2026-03-29 10:39:44 [auto1.de] INFO: Scrape type for BK52975: 0
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: VH62706
2026-03-29 10:39:44 [auto1.de] INFO: Found listing with ID: NZ04570
2026-03-29 10:39:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:46 [auto1.de] INFO: Channel: 24h | Page: 77 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:46 [auto1.de] INFO: Found listing with ID: BN48826
2026-03-29 10:39:46 [auto1.de] INFO: Found listing with ID: DE77804
2026-03-29 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE77804%27 HTTP/1.1" 200 None
2026-03-29 10:39:46 [auto1.de] INFO: Scrape type for DE77804: 0
2026-03-29 10:39:46 [auto1.de] INFO: Found listing with ID: FC29722
2026-03-29 10:39:46 [auto1.de] INFO: Found listing with ID: EB96923
2026-03-29 10:39:46 [auto1.de] INFO: Found listing with ID: XK03693
2026-03-29 10:39:46 [auto1.de] INFO: Found listing with ID: RG76834
2026-03-29 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG76834%27 HTTP/1.1" 200 None
2026-03-29 10:39:47 [auto1.de] INFO: Scrape type for RG76834: 0
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: AG34789
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: WL56832
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: MN63665
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN63665%27 HTTP/1.1" 200 None
2026-03-29 10:39:47 [auto1.de] INFO: Scrape type for MN63665: 0
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: WH84573
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH84573%27 HTTP/1.1" 200 None
2026-03-29 10:39:47 [auto1.de] INFO: Scrape type for WH84573: 0
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: JL94841
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL94841%27 HTTP/1.1" 200 None
2026-03-29 10:39:47 [auto1.de] INFO: Scrape type for JL94841: 0
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: MR61415
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: SA01659
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: KC01296
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC01296%27 HTTP/1.1" 200 None
2026-03-29 10:39:47 [auto1.de] INFO: Scrape type for KC01296: 0
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: KP87344
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: MV77064
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV77064%27 HTTP/1.1" 200 None
2026-03-29 10:39:47 [auto1.de] INFO: Scrape type for MV77064: 0
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: MS57219
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: UC78580
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC78580%27 HTTP/1.1" 200 None
2026-03-29 10:39:47 [auto1.de] INFO: Scrape type for UC78580: 0
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: HZ18082
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ18082%27 HTTP/1.1" 200 None
2026-03-29 10:39:47 [auto1.de] INFO: Scrape type for HZ18082: 0
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: LK29782
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: HD39951
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: MX99530
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX99530%27 HTTP/1.1" 200 None
2026-03-29 10:39:47 [auto1.de] INFO: Scrape type for MX99530: 0
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: BB20328
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: JM51025
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: KV22200
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV22200%27 HTTP/1.1" 200 None
2026-03-29 10:39:47 [auto1.de] INFO: Scrape type for KV22200: 0
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: MV46979
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV46979%27 HTTP/1.1" 200 None
2026-03-29 10:39:47 [auto1.de] INFO: Scrape type for MV46979: 0
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: YB52644
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB52644%27 HTTP/1.1" 200 None
2026-03-29 10:39:47 [auto1.de] INFO: Scrape type for YB52644: 0
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: TN55927
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: SH34786
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH34786%27 HTTP/1.1" 200 None
2026-03-29 10:39:47 [auto1.de] INFO: Scrape type for SH34786: 0
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: UG24808
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG24808%27 HTTP/1.1" 200 None
2026-03-29 10:39:47 [auto1.de] INFO: Scrape type for UG24808: 0
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: WA42384
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA42384%27 HTTP/1.1" 200 None
2026-03-29 10:39:47 [auto1.de] INFO: Scrape type for WA42384: 0
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: EV99140
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: EW54456
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: WN48846
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN48846%27 HTTP/1.1" 200 None
2026-03-29 10:39:47 [auto1.de] INFO: Scrape type for WN48846: 0
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: GM15631
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: BM78825
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM78825%27 HTTP/1.1" 200 None
2026-03-29 10:39:47 [auto1.de] INFO: Scrape type for BM78825: 0
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: EW11176
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: GK51404
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: WD28635
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD28635%27 HTTP/1.1" 200 None
2026-03-29 10:39:47 [auto1.de] INFO: Scrape type for WD28635: 0
2026-03-29 10:39:47 [auto1.de] INFO: Found listing with ID: GR91976
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR91976%27 HTTP/1.1" 200 None
2026-03-29 10:39:47 [auto1.de] INFO: Scrape type for GR91976: 0
2026-03-29 10:39:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:48 [auto1.de] INFO: Channel: 24h | Page: 78 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:48 [auto1.de] INFO: Found listing with ID: SG67731
2026-03-29 10:39:48 [auto1.de] INFO: Found listing with ID: VY52691
2026-03-29 10:39:48 [auto1.de] INFO: Found listing with ID: PC09309
2026-03-29 10:39:48 [auto1.de] INFO: Found listing with ID: XK79004
2026-03-29 10:39:48 [auto1.de] INFO: Found listing with ID: LG80642
2026-03-29 10:39:48 [auto1.de] INFO: Found listing with ID: NN62521
2026-03-29 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN62521%27 HTTP/1.1" 200 None
2026-03-29 10:39:48 [auto1.de] INFO: Scrape type for NN62521: 0
2026-03-29 10:39:48 [auto1.de] INFO: Found listing with ID: FM78984
2026-03-29 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM78984%27 HTTP/1.1" 200 None
2026-03-29 10:39:48 [auto1.de] INFO: Scrape type for FM78984: 0
2026-03-29 10:39:48 [auto1.de] INFO: Found listing with ID: MN24694
2026-03-29 10:39:48 [auto1.de] INFO: Found listing with ID: TL40939
2026-03-29 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL40939%27 HTTP/1.1" 200 None
2026-03-29 10:39:48 [auto1.de] INFO: Scrape type for TL40939: 0
2026-03-29 10:39:48 [auto1.de] INFO: Found listing with ID: RW72462
2026-03-29 10:39:48 [auto1.de] INFO: Found listing with ID: BG03972
2026-03-29 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG03972%27 HTTP/1.1" 200 None
2026-03-29 10:39:48 [auto1.de] INFO: Scrape type for BG03972: 0
2026-03-29 10:39:48 [auto1.de] INFO: Found listing with ID: DA12198
2026-03-29 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA12198%27 HTTP/1.1" 200 None
2026-03-29 10:39:48 [auto1.de] INFO: Scrape type for DA12198: 0
2026-03-29 10:39:48 [auto1.de] INFO: Found listing with ID: MC04391
2026-03-29 10:39:48 [auto1.de] INFO: Found listing with ID: HY48346
2026-03-29 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY48346%27 HTTP/1.1" 200 None
2026-03-29 10:39:48 [auto1.de] INFO: Scrape type for HY48346: 0
2026-03-29 10:39:48 [auto1.de] INFO: Found listing with ID: YL44466
2026-03-29 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL44466%27 HTTP/1.1" 200 None
2026-03-29 10:39:48 [auto1.de] INFO: Scrape type for YL44466: 0
2026-03-29 10:39:48 [auto1.de] INFO: Found listing with ID: KF79768
2026-03-29 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF79768%27 HTTP/1.1" 200 None
2026-03-29 10:39:48 [auto1.de] INFO: Scrape type for KF79768: 0
2026-03-29 10:39:48 [auto1.de] INFO: Found listing with ID: KE01468
2026-03-29 10:39:48 [auto1.de] INFO: Found listing with ID: PS82171
2026-03-29 10:39:48 [auto1.de] INFO: Found listing with ID: AW33862
2026-03-29 10:39:48 [auto1.de] INFO: Found listing with ID: CX46071
2026-03-29 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX46071%27 HTTP/1.1" 200 None
2026-03-29 10:39:48 [auto1.de] INFO: Scrape type for CX46071: 0
2026-03-29 10:39:48 [auto1.de] INFO: Found listing with ID: YS99143
2026-03-29 10:39:48 [auto1.de] INFO: Found listing with ID: PC54286
2026-03-29 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC54286%27 HTTP/1.1" 200 None
2026-03-29 10:39:48 [auto1.de] INFO: Scrape type for PC54286: 2
2026-03-29 10:39:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f25b0ed4-b2b0-5977-919b-05d0ec3de59d with identifier: PC54286
2026-03-29 10:39:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f25b0ed4-b2b0-5977-919b-05d0ec3de59d with scrape type 2
2026-03-29 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f25b0ed4-b2b0-5977-919b-05d0ec3de59d with scrape type 2
2026-03-29 10:39:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f25b0ed4-b2b0-5977-919b-05d0ec3de59d, identifier: PC54286
2026-03-29 10:39:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f25b0ed4-b2b0-5977-919b-05d0ec3de59d with identifier: PC54286
2026-03-29 10:39:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f25b0ed4-b2b0-5977-919b-05d0ec3de59d with identifier: PC54286
2026-03-29 10:39:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f25b0ed4-b2b0-5977-919b-05d0ec3de59d with identifier: PC54286 to the API
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:39:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:03:12Z',
 'fuel_type': 'petrol',
 'id': 'f25b0ed4-b2b0-5977-919b-05d0ec3de59d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC54286',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 209350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-27',
 'seller_name': None,
 'title': 'BMW 3er 318i',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC54286%27 HTTP/1.1" 200 None
2026-03-29 10:39:49 [auto1.de] INFO: Saving data for PC54286: {'auction_closing_time': 1774882992.0, 'created_time': 1774031817.763492, 'last_price_update_time': 1774780789.404002}
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC54286') HTTP/1.1" 204 0
2026-03-29 10:39:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: WB36208
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: WS03851
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: JB91178
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB91178%27 HTTP/1.1" 200 None
2026-03-29 10:39:49 [auto1.de] INFO: Scrape type for JB91178: 0
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: AA01467
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: SZ50241
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ50241%27 HTTP/1.1" 200 None
2026-03-29 10:39:49 [auto1.de] INFO: Scrape type for SZ50241: 0
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: LD03873
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: RR13548
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR13548%27 HTTP/1.1" 200 None
2026-03-29 10:39:49 [auto1.de] INFO: Scrape type for RR13548: 0
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: XT20233
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: TG47191
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG47191%27 HTTP/1.1" 200 None
2026-03-29 10:39:49 [auto1.de] INFO: Scrape type for TG47191: 0
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: RW82332
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW82332%27 HTTP/1.1" 200 None
2026-03-29 10:39:49 [auto1.de] INFO: Scrape type for RW82332: 0
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: ZV10923
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV10923%27 HTTP/1.1" 200 None
2026-03-29 10:39:49 [auto1.de] INFO: Scrape type for ZV10923: 0
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: TK34912
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: FJ71547
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: YN11150
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN11150%27 HTTP/1.1" 200 None
2026-03-29 10:39:49 [auto1.de] INFO: Scrape type for YN11150: 0
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: KF63031
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: LV55380
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV55380%27 HTTP/1.1" 200 None
2026-03-29 10:39:49 [auto1.de] INFO: Scrape type for LV55380: 0
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: HZ95747
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ95747%27 HTTP/1.1" 200 None
2026-03-29 10:39:49 [auto1.de] INFO: Scrape type for HZ95747: 0
2026-03-29 10:39:49 [auto1.de] INFO: Found listing with ID: RJ73659
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ73659%27 HTTP/1.1" 200 None
2026-03-29 10:39:49 [auto1.de] INFO: Scrape type for RJ73659: 0
2026-03-29 10:39:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:51 [auto1.de] INFO: Channel: 24h | Page: 79 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: EU22008
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: BS97689
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS97689%27 HTTP/1.1" 200 None
2026-03-29 10:39:51 [auto1.de] INFO: Scrape type for BS97689: 0
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: FZ03157
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ03157%27 HTTP/1.1" 200 None
2026-03-29 10:39:51 [auto1.de] INFO: Scrape type for FZ03157: 0
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: KF55313
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: HD43211
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD43211%27 HTTP/1.1" 200 None
2026-03-29 10:39:51 [auto1.de] INFO: Scrape type for HD43211: 0
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: UW00779
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: BD76424
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD76424%27 HTTP/1.1" 200 None
2026-03-29 10:39:51 [auto1.de] INFO: Scrape type for BD76424: 0
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: KZ71563
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ71563%27 HTTP/1.1" 200 None
2026-03-29 10:39:51 [auto1.de] INFO: Scrape type for KZ71563: 0
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: CE41516
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: SL45023
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL45023%27 HTTP/1.1" 200 None
2026-03-29 10:39:51 [auto1.de] INFO: Scrape type for SL45023: 0
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: LK80095
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK80095%27 HTTP/1.1" 200 None
2026-03-29 10:39:51 [auto1.de] INFO: Scrape type for LK80095: 0
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: CM30450
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM30450%27 HTTP/1.1" 200 None
2026-03-29 10:39:51 [auto1.de] INFO: Scrape type for CM30450: 0
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: PW82194
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: YR75545
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR75545%27 HTTP/1.1" 200 None
2026-03-29 10:39:51 [auto1.de] INFO: Scrape type for YR75545: 0
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: JT47484
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: HT39177
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: HA14963
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA14963%27 HTTP/1.1" 200 None
2026-03-29 10:39:51 [auto1.de] INFO: Scrape type for HA14963: 0
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: GX32204
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX32204%27 HTTP/1.1" 200 None
2026-03-29 10:39:51 [auto1.de] INFO: Scrape type for GX32204: 0
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: XA88514
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: BP38143
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP38143%27 HTTP/1.1" 200 None
2026-03-29 10:39:51 [auto1.de] INFO: Scrape type for BP38143: 0
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: UA25928
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA25928%27 HTTP/1.1" 200 None
2026-03-29 10:39:51 [auto1.de] INFO: Scrape type for UA25928: 0
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: UB19206
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: YA52648
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: HB57575
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB57575%27 HTTP/1.1" 200 None
2026-03-29 10:39:51 [auto1.de] INFO: Scrape type for HB57575: 0
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: GK41748
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: GT24864
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT24864%27 HTTP/1.1" 200 None
2026-03-29 10:39:51 [auto1.de] INFO: Scrape type for GT24864: 0
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: VE54720
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: GG65874
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG65874%27 HTTP/1.1" 200 None
2026-03-29 10:39:51 [auto1.de] INFO: Scrape type for GG65874: 0
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: UF58190
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF58190%27 HTTP/1.1" 200 None
2026-03-29 10:39:51 [auto1.de] INFO: Scrape type for UF58190: 0
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: FP35448
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: ZA93244
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA93244%27 HTTP/1.1" 200 None
2026-03-29 10:39:51 [auto1.de] INFO: Scrape type for ZA93244: 0
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: JU23189
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: AL15511
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL15511%27 HTTP/1.1" 200 None
2026-03-29 10:39:51 [auto1.de] INFO: Scrape type for AL15511: 0
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: RV42869
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV42869%27 HTTP/1.1" 200 None
2026-03-29 10:39:51 [auto1.de] INFO: Scrape type for RV42869: 0
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: TB15164
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB15164%27 HTTP/1.1" 200 None
2026-03-29 10:39:51 [auto1.de] INFO: Scrape type for TB15164: 0
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: WM92203
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM92203%27 HTTP/1.1" 200 None
2026-03-29 10:39:51 [auto1.de] INFO: Scrape type for WM92203: 0
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: NK87306
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK87306%27 HTTP/1.1" 200 None
2026-03-29 10:39:51 [auto1.de] INFO: Scrape type for NK87306: 0
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: CN06101
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN06101%27 HTTP/1.1" 200 None
2026-03-29 10:39:51 [auto1.de] INFO: Scrape type for CN06101: 0
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: PC18756
2026-03-29 10:39:51 [auto1.de] INFO: Found listing with ID: DG36538
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG36538%27 HTTP/1.1" 200 None
2026-03-29 10:39:51 [auto1.de] INFO: Scrape type for DG36538: 0
2026-03-29 10:39:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:39:58 [auto1.de] INFO: Channel: 24h | Page: 80 | totalHits: 6726 | hits on page: 40
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: YT48598
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: PS82435
2026-03-29 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS82435%27 HTTP/1.1" 200 None
2026-03-29 10:39:58 [auto1.de] INFO: Scrape type for PS82435: 0
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: KG20268
2026-03-29 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG20268%27 HTTP/1.1" 200 None
2026-03-29 10:39:58 [auto1.de] INFO: Scrape type for KG20268: 0
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: FC76019
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: UZ90215
2026-03-29 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ90215%27 HTTP/1.1" 200 None
2026-03-29 10:39:58 [auto1.de] INFO: Scrape type for UZ90215: 0
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: CK93777
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: TX61544
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: ET07412
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: XC17243
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: BL84965
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: HU93536
2026-03-29 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU93536%27 HTTP/1.1" 200 None
2026-03-29 10:39:58 [auto1.de] INFO: Scrape type for HU93536: 0
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: ZT89022
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: MA73958
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: GF09029
2026-03-29 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF09029%27 HTTP/1.1" 200 None
2026-03-29 10:39:58 [auto1.de] INFO: Scrape type for GF09029: 0
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: JC65588
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: AE03495
2026-03-29 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE03495%27 HTTP/1.1" 200 None
2026-03-29 10:39:58 [auto1.de] INFO: Scrape type for AE03495: 0
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: ZH21180
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: UW39505
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: PZ10151
2026-03-29 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ10151%27 HTTP/1.1" 200 None
2026-03-29 10:39:58 [auto1.de] INFO: Scrape type for PZ10151: 0
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: LT21646
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: MD20057
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: EC25925
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: FL94183
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: DE69910
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: BP24575
2026-03-29 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP24575%27 HTTP/1.1" 200 None
2026-03-29 10:39:58 [auto1.de] INFO: Scrape type for BP24575: 0
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: EU24195
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: NT60185
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: NT27020
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: VY22593
2026-03-29 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY22593%27 HTTP/1.1" 200 None
2026-03-29 10:39:58 [auto1.de] INFO: Scrape type for VY22593: 0
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: RT01969
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: ZV29308
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: LG87332
2026-03-29 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG87332%27 HTTP/1.1" 200 None
2026-03-29 10:39:58 [auto1.de] INFO: Scrape type for LG87332: 0
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: MS65923
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: PE09652
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: SX60280
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: TU96815
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: LW42175
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: SW77788
2026-03-29 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW77788%27 HTTP/1.1" 200 None
2026-03-29 10:39:58 [auto1.de] INFO: Scrape type for SW77788: 0
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: XT42199
2026-03-29 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT42199%27 HTTP/1.1" 200 None
2026-03-29 10:39:58 [auto1.de] INFO: Scrape type for XT42199: 0
2026-03-29 10:39:58 [auto1.de] INFO: Found listing with ID: DE42625
2026-03-29 10:39:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:40:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:40:03 [auto1.de] INFO: Channel: 24h | Page: 81 | totalHits: 6726 | hits on page: 40
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: RC01446
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: JA64656
2026-03-29 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA64656%27 HTTP/1.1" 200 None
2026-03-29 10:40:03 [auto1.de] INFO: Scrape type for JA64656: 0
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: HF86895
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: HR57506
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: PD67762
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: RM72626
2026-03-29 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM72626%27 HTTP/1.1" 200 None
2026-03-29 10:40:03 [auto1.de] INFO: Scrape type for RM72626: 0
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: SA50642
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: XS43563
2026-03-29 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS43563%27 HTTP/1.1" 200 None
2026-03-29 10:40:03 [auto1.de] INFO: Scrape type for XS43563: 0
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: VB65040
2026-03-29 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB65040%27 HTTP/1.1" 200 None
2026-03-29 10:40:03 [auto1.de] INFO: Scrape type for VB65040: 0
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: GM47642
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: TT29598
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: DR69108
2026-03-29 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR69108%27 HTTP/1.1" 200 None
2026-03-29 10:40:03 [auto1.de] INFO: Scrape type for DR69108: 0
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: GT81151
2026-03-29 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT81151%27 HTTP/1.1" 200 None
2026-03-29 10:40:03 [auto1.de] INFO: Scrape type for GT81151: 0
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: GR47170
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: UH95210
2026-03-29 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH95210%27 HTTP/1.1" 200 None
2026-03-29 10:40:03 [auto1.de] INFO: Scrape type for UH95210: 0
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: XM87462
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: XA78994
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: FE02336
2026-03-29 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE02336%27 HTTP/1.1" 200 None
2026-03-29 10:40:03 [auto1.de] INFO: Scrape type for FE02336: 0
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: MJ48017
2026-03-29 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ48017%27 HTTP/1.1" 200 None
2026-03-29 10:40:03 [auto1.de] INFO: Scrape type for MJ48017: 0
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: YK99785
2026-03-29 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK99785%27 HTTP/1.1" 200 None
2026-03-29 10:40:03 [auto1.de] INFO: Scrape type for YK99785: 0
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: ZU26768
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: EV16310
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: FG55582
2026-03-29 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG55582%27 HTTP/1.1" 200 None
2026-03-29 10:40:03 [auto1.de] INFO: Scrape type for FG55582: 0
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: BP25717
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: XJ41164
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: CK35752
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: WY50378
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: MG94250
2026-03-29 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG94250%27 HTTP/1.1" 200 None
2026-03-29 10:40:03 [auto1.de] INFO: Scrape type for MG94250: 0
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: DD29565
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: WE11389
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: CH51511
2026-03-29 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH51511%27 HTTP/1.1" 200 None
2026-03-29 10:40:03 [auto1.de] INFO: Scrape type for CH51511: 0
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: GR34047
2026-03-29 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR34047%27 HTTP/1.1" 200 None
2026-03-29 10:40:03 [auto1.de] INFO: Scrape type for GR34047: 0
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: GE71981
2026-03-29 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE71981%27 HTTP/1.1" 200 None
2026-03-29 10:40:03 [auto1.de] INFO: Scrape type for GE71981: 0
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: PK93112
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: YT53234
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: MW86631
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: WS02654
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: PF97511
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: KB32538
2026-03-29 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB32538%27 HTTP/1.1" 200 None
2026-03-29 10:40:03 [auto1.de] INFO: Scrape type for KB32538: 0
2026-03-29 10:40:03 [auto1.de] INFO: Found listing with ID: FR65686
2026-03-29 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR65686%27 HTTP/1.1" 200 None
2026-03-29 10:40:03 [auto1.de] INFO: Scrape type for FR65686: 0
2026-03-29 10:40:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:40:06 [scrapy.extensions.logstats] INFO: Crawled 143 pages (at 22 pages/min), scraped 240 items (at 6 items/min)
2026-03-29 10:40:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 160MiB
2026-03-29 10:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:40:14 [auto1.de] INFO: Channel: 24h | Page: 82 | totalHits: 6726 | hits on page: 40
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: RX17782
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX17782%27 HTTP/1.1" 200 None
2026-03-29 10:40:14 [auto1.de] INFO: Scrape type for RX17782: 0
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: SN13100
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN13100%27 HTTP/1.1" 200 None
2026-03-29 10:40:14 [auto1.de] INFO: Scrape type for SN13100: 0
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: SV05588
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV05588%27 HTTP/1.1" 200 None
2026-03-29 10:40:14 [auto1.de] INFO: Scrape type for SV05588: 0
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: DD70281
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: PE91450
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: VS10261
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: VR85495
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR85495%27 HTTP/1.1" 200 None
2026-03-29 10:40:14 [auto1.de] INFO: Scrape type for VR85495: 0
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: MW87907
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW87907%27 HTTP/1.1" 200 None
2026-03-29 10:40:14 [auto1.de] INFO: Scrape type for MW87907: 0
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: RE51747
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE51747%27 HTTP/1.1" 200 None
2026-03-29 10:40:14 [auto1.de] INFO: Scrape type for RE51747: 0
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: NG44703
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: XW64157
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW64157%27 HTTP/1.1" 200 None
2026-03-29 10:40:14 [auto1.de] INFO: Scrape type for XW64157: 0
2026-03-29 10:40:14 [auto1.de] INFO: Found listing with ID: RT05555
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT05555%27 HTTP/1.1" 200 None
2026-03-29 10:40:15 [auto1.de] INFO: Scrape type for RT05555: 0
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: MM04767
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM04767%27 HTTP/1.1" 200 None
2026-03-29 10:40:15 [auto1.de] INFO: Scrape type for MM04767: 0
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: MS75707
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: TH77412
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: JZ77748
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ77748%27 HTTP/1.1" 200 None
2026-03-29 10:40:15 [auto1.de] INFO: Scrape type for JZ77748: 2
2026-03-29 10:40:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbbe0278-0a93-56cc-96c8-0997bd0d329b with identifier: JZ77748
2026-03-29 10:40:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbbe0278-0a93-56cc-96c8-0997bd0d329b with scrape type 2
2026-03-29 10:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbbe0278-0a93-56cc-96c8-0997bd0d329b with scrape type 2
2026-03-29 10:40:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dbbe0278-0a93-56cc-96c8-0997bd0d329b, identifier: JZ77748
2026-03-29 10:40:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dbbe0278-0a93-56cc-96c8-0997bd0d329b with identifier: JZ77748
2026-03-29 10:40:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dbbe0278-0a93-56cc-96c8-0997bd0d329b with identifier: JZ77748
2026-03-29 10:40:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dbbe0278-0a93-56cc-96c8-0997bd0d329b with identifier: JZ77748 to the API
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:40:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:50:10Z',
 'fuel_type': 'petrol',
 'id': 'dbbe0278-0a93-56cc-96c8-0997bd0d329b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ77748',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 127615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-24',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ77748%27 HTTP/1.1" 200 None
2026-03-29 10:40:15 [auto1.de] INFO: Saving data for JZ77748: {'auction_closing_time': 1774885810.0, 'created_time': 1773227161.848172, 'last_price_update_time': 1774780815.679117}
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JZ77748') HTTP/1.1" 204 0
2026-03-29 10:40:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: SZ55877
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: HC69827
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC69827%27 HTTP/1.1" 200 None
2026-03-29 10:40:15 [auto1.de] INFO: Scrape type for HC69827: 0
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: CH79941
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: TH50819
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH50819%27 HTTP/1.1" 200 None
2026-03-29 10:40:15 [auto1.de] INFO: Scrape type for TH50819: 0
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: XY47977
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY47977%27 HTTP/1.1" 200 None
2026-03-29 10:40:15 [auto1.de] INFO: Scrape type for XY47977: 0
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: BX70846
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: ZZ62402
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: VV79476
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV79476%27 HTTP/1.1" 200 None
2026-03-29 10:40:15 [auto1.de] INFO: Scrape type for VV79476: 0
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: HY86490
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY86490%27 HTTP/1.1" 200 None
2026-03-29 10:40:15 [auto1.de] INFO: Scrape type for HY86490: 0
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: WM31367
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: AK43100
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: AG24612
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG24612%27 HTTP/1.1" 200 None
2026-03-29 10:40:15 [auto1.de] INFO: Scrape type for AG24612: 0
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: SD59172
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: SR59541
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: GJ71722
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: MW31978
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: HV44481
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: NY67891
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: BK73701
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK73701%27 HTTP/1.1" 200 None
2026-03-29 10:40:15 [auto1.de] INFO: Scrape type for BK73701: 0
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: SU06279
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: HW53715
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: CR35436
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: TA42625
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA42625%27 HTTP/1.1" 200 None
2026-03-29 10:40:15 [auto1.de] INFO: Scrape type for TA42625: 0
2026-03-29 10:40:15 [auto1.de] INFO: Found listing with ID: JC63536
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC63536%27 HTTP/1.1" 200 None
2026-03-29 10:40:15 [auto1.de] INFO: Scrape type for JC63536: 0
2026-03-29 10:40:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:40:35 [auto1.de] INFO: Channel: 24h | Page: 83 | totalHits: 6726 | hits on page: 40
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: NV55096
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV55096%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for NV55096: 0
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: HR44152
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: HY59950
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY59950%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for HY59950: 0
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: CV89057
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: JE47018
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE47018%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for JE47018: 0
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: KU99299
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU99299%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for KU99299: 0
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: AJ13004
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ13004%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for AJ13004: 0
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: YS01662
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: TN35459
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN35459%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for TN35459: 0
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: EV46611
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV46611%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for EV46611: 0
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: MW80784
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW80784%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for MW80784: 0
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: DC51823
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC51823%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for DC51823: 0
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: XF30370
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF30370%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for XF30370: 0
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: PK45675
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK45675%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for PK45675: 0
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: TT59921
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT59921%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for TT59921: 0
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: AA30425
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: AB14083
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: SM63646
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM63646%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for SM63646: 0
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: HA91024
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA91024%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for HA91024: 0
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: DL45560
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: GC28656
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: KC24735
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC24735%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for KC24735: 0
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: BV81502
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: KT10840
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: JK17459
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: KX98394
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX98394%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for KX98394: 0
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: AK58988
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: ZN63350
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: HR13595
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: TE39343
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: PE88968
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE88968%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for PE88968: 0
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: LX71576
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX71576%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for LX71576: 0
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: FG79588
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG79588%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for FG79588: 0
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: PP85770
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: FC75041
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: AA02117
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA02117%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for AA02117: 0
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: AH71943
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: VY07286
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: ZE79625
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE79625%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for ZE79625: 0
2026-03-29 10:40:35 [auto1.de] INFO: Found listing with ID: PK47596
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK47596%27 HTTP/1.1" 200 None
2026-03-29 10:40:35 [auto1.de] INFO: Scrape type for PK47596: 0
2026-03-29 10:40:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:40:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:40:36 [auto1.de] INFO: Channel: 24h | Page: 84 | totalHits: 6726 | hits on page: 40
2026-03-29 10:40:36 [auto1.de] INFO: Found listing with ID: KP81674
2026-03-29 10:40:36 [auto1.de] INFO: Found listing with ID: FT31566
2026-03-29 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT31566%27 HTTP/1.1" 200 None
2026-03-29 10:40:36 [auto1.de] INFO: Scrape type for FT31566: 0
2026-03-29 10:40:36 [auto1.de] INFO: Found listing with ID: HK24290
2026-03-29 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK24290%27 HTTP/1.1" 200 None
2026-03-29 10:40:36 [auto1.de] INFO: Scrape type for HK24290: 0
2026-03-29 10:40:36 [auto1.de] INFO: Found listing with ID: AN45666
2026-03-29 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN45666%27 HTTP/1.1" 200 None
2026-03-29 10:40:36 [auto1.de] INFO: Scrape type for AN45666: 0
2026-03-29 10:40:36 [auto1.de] INFO: Found listing with ID: TG58212
2026-03-29 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG58212%27 HTTP/1.1" 200 None
2026-03-29 10:40:36 [auto1.de] INFO: Scrape type for TG58212: 0
2026-03-29 10:40:36 [auto1.de] INFO: Found listing with ID: LW56593
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW56593%27 HTTP/1.1" 200 None
2026-03-29 10:40:37 [auto1.de] INFO: Scrape type for LW56593: 0
2026-03-29 10:40:37 [auto1.de] INFO: Found listing with ID: JN51648
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN51648%27 HTTP/1.1" 200 None
2026-03-29 10:40:37 [auto1.de] INFO: Scrape type for JN51648: 0
2026-03-29 10:40:37 [auto1.de] INFO: Found listing with ID: MG63340
2026-03-29 10:40:37 [auto1.de] INFO: Found listing with ID: KK98414
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK98414%27 HTTP/1.1" 200 None
2026-03-29 10:40:37 [auto1.de] INFO: Scrape type for KK98414: 0
2026-03-29 10:40:37 [auto1.de] INFO: Found listing with ID: WL72774
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL72774%27 HTTP/1.1" 200 None
2026-03-29 10:40:37 [auto1.de] INFO: Scrape type for WL72774: 0
2026-03-29 10:40:37 [auto1.de] INFO: Found listing with ID: LS10539
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS10539%27 HTTP/1.1" 200 None
2026-03-29 10:40:37 [auto1.de] INFO: Scrape type for LS10539: 0
2026-03-29 10:40:37 [auto1.de] INFO: Found listing with ID: UE11202
2026-03-29 10:40:37 [auto1.de] INFO: Found listing with ID: UY19816
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY19816%27 HTTP/1.1" 200 None
2026-03-29 10:40:37 [auto1.de] INFO: Scrape type for UY19816: 0
2026-03-29 10:40:37 [auto1.de] INFO: Found listing with ID: JN06918
2026-03-29 10:40:37 [auto1.de] INFO: Found listing with ID: AR60138
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR60138%27 HTTP/1.1" 200 None
2026-03-29 10:40:37 [auto1.de] INFO: Scrape type for AR60138: 0
2026-03-29 10:40:37 [auto1.de] INFO: Found listing with ID: MW91304
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW91304%27 HTTP/1.1" 200 None
2026-03-29 10:40:37 [auto1.de] INFO: Scrape type for MW91304: 0
2026-03-29 10:40:37 [auto1.de] INFO: Found listing with ID: MX37955
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX37955%27 HTTP/1.1" 200 None
2026-03-29 10:40:37 [auto1.de] INFO: Scrape type for MX37955: 0
2026-03-29 10:40:37 [auto1.de] INFO: Found listing with ID: AH29152
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH29152%27 HTTP/1.1" 200 None
2026-03-29 10:40:37 [auto1.de] INFO: Scrape type for AH29152: 0
2026-03-29 10:40:37 [auto1.de] INFO: Found listing with ID: HU16718
2026-03-29 10:40:37 [auto1.de] INFO: Found listing with ID: LP86406
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP86406%27 HTTP/1.1" 200 None
2026-03-29 10:40:37 [auto1.de] INFO: Scrape type for LP86406: 0
2026-03-29 10:40:37 [auto1.de] INFO: Found listing with ID: ZJ39351
2026-03-29 10:40:37 [auto1.de] INFO: Found listing with ID: VS89530
2026-03-29 10:40:37 [auto1.de] INFO: Found listing with ID: HZ19691
2026-03-29 10:40:37 [auto1.de] INFO: Found listing with ID: RR18814
2026-03-29 10:40:37 [auto1.de] INFO: Found listing with ID: FJ71041
2026-03-29 10:40:37 [auto1.de] INFO: Found listing with ID: LC91411
2026-03-29 10:40:37 [auto1.de] INFO: Found listing with ID: DT28740
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT28740%27 HTTP/1.1" 200 None
2026-03-29 10:40:37 [auto1.de] INFO: Scrape type for DT28740: 0
2026-03-29 10:40:37 [auto1.de] INFO: Found listing with ID: WY11895
2026-03-29 10:40:37 [auto1.de] INFO: Found listing with ID: MD93182
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD93182%27 HTTP/1.1" 200 None
2026-03-29 10:40:37 [auto1.de] INFO: Scrape type for MD93182: 0
2026-03-29 10:40:37 [auto1.de] INFO: Found listing with ID: NY19608
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY19608%27 HTTP/1.1" 200 None
2026-03-29 10:40:37 [auto1.de] INFO: Scrape type for NY19608: 0
2026-03-29 10:40:37 [auto1.de] INFO: Found listing with ID: FZ44442
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ44442%27 HTTP/1.1" 200 None
2026-03-29 10:40:37 [auto1.de] INFO: Scrape type for FZ44442: 0
2026-03-29 10:40:37 [auto1.de] INFO: Found listing with ID: VE70317
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE70317%27 HTTP/1.1" 200 None
2026-03-29 10:40:37 [auto1.de] INFO: Scrape type for VE70317: 0
2026-03-29 10:40:37 [auto1.de] INFO: Found listing with ID: NA53807
2026-03-29 10:40:37 [auto1.de] INFO: Found listing with ID: AY55181
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY55181%27 HTTP/1.1" 200 None
2026-03-29 10:40:37 [auto1.de] INFO: Scrape type for AY55181: 0
2026-03-29 10:40:37 [auto1.de] INFO: Found listing with ID: VL50005
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL50005%27 HTTP/1.1" 200 None
2026-03-29 10:40:37 [auto1.de] INFO: Scrape type for VL50005: 0
2026-03-29 10:40:37 [auto1.de] INFO: Found listing with ID: SR18060
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR18060%27 HTTP/1.1" 200 None
2026-03-29 10:40:37 [auto1.de] INFO: Scrape type for SR18060: 0
2026-03-29 10:40:37 [auto1.de] INFO: Found listing with ID: UW78098
2026-03-29 10:40:37 [auto1.de] INFO: Found listing with ID: AE84214
2026-03-29 10:40:37 [auto1.de] INFO: Found listing with ID: DX51383
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX51383%27 HTTP/1.1" 200 None
2026-03-29 10:40:37 [auto1.de] INFO: Scrape type for DX51383: 0
2026-03-29 10:40:37 [auto1.de] INFO: Found listing with ID: KD94440
2026-03-29 10:40:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:40:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:40:45 [auto1.de] INFO: Channel: 24h | Page: 85 | totalHits: 6726 | hits on page: 40
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: ZM65960
2026-03-29 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM65960%27 HTTP/1.1" 200 None
2026-03-29 10:40:45 [auto1.de] INFO: Scrape type for ZM65960: 0
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: XU28434
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: XR62561
2026-03-29 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR62561%27 HTTP/1.1" 200 None
2026-03-29 10:40:45 [auto1.de] INFO: Scrape type for XR62561: 0
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: KL26301
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: TL66452
2026-03-29 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL66452%27 HTTP/1.1" 200 None
2026-03-29 10:40:45 [auto1.de] INFO: Scrape type for TL66452: 0
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: UK28152
2026-03-29 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK28152%27 HTTP/1.1" 200 None
2026-03-29 10:40:45 [auto1.de] INFO: Scrape type for UK28152: 0
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: WK26503
2026-03-29 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK26503%27 HTTP/1.1" 200 None
2026-03-29 10:40:45 [auto1.de] INFO: Scrape type for WK26503: 0
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: BG43270
2026-03-29 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG43270%27 HTTP/1.1" 200 None
2026-03-29 10:40:45 [auto1.de] INFO: Scrape type for BG43270: 0
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: FF92976
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: BV74864
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: CV55682
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: MR72377
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: SX94588
2026-03-29 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX94588%27 HTTP/1.1" 200 None
2026-03-29 10:40:45 [auto1.de] INFO: Scrape type for SX94588: 0
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: RZ91984
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: JU32018
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: RU59623
2026-03-29 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU59623%27 HTTP/1.1" 200 None
2026-03-29 10:40:45 [auto1.de] INFO: Scrape type for RU59623: 0
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: DB64139
2026-03-29 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB64139%27 HTTP/1.1" 200 None
2026-03-29 10:40:45 [auto1.de] INFO: Scrape type for DB64139: 0
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: RS77004
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: YJ68996
2026-03-29 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ68996%27 HTTP/1.1" 200 None
2026-03-29 10:40:45 [auto1.de] INFO: Scrape type for YJ68996: 0
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: FJ91980
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: BN30919
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: HX66232
2026-03-29 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX66232%27 HTTP/1.1" 200 None
2026-03-29 10:40:45 [auto1.de] INFO: Scrape type for HX66232: 0
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: GS36326
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: TV33488
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: HP10978
2026-03-29 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP10978%27 HTTP/1.1" 200 None
2026-03-29 10:40:45 [auto1.de] INFO: Scrape type for HP10978: 0
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: DF38507
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: CW72943
2026-03-29 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW72943%27 HTTP/1.1" 200 None
2026-03-29 10:40:45 [auto1.de] INFO: Scrape type for CW72943: 0
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: BR64184
2026-03-29 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR64184%27 HTTP/1.1" 200 None
2026-03-29 10:40:45 [auto1.de] INFO: Scrape type for BR64184: 0
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: NX47984
2026-03-29 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX47984%27 HTTP/1.1" 200 None
2026-03-29 10:40:45 [auto1.de] INFO: Scrape type for NX47984: 0
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: BN50743
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: GA25019
2026-03-29 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA25019%27 HTTP/1.1" 200 None
2026-03-29 10:40:45 [auto1.de] INFO: Scrape type for GA25019: 0
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: FD55088
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: ZD02189
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: XX76692
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: SJ47682
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: YH89346
2026-03-29 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH89346%27 HTTP/1.1" 200 None
2026-03-29 10:40:45 [auto1.de] INFO: Scrape type for YH89346: 0
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: CG28709
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: JT24059
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: CW96119
2026-03-29 10:40:45 [auto1.de] INFO: Found listing with ID: JJ41202
2026-03-29 10:40:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:40:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:40:54 [auto1.de] INFO: Channel: 24h | Page: 86 | totalHits: 6726 | hits on page: 40
2026-03-29 10:40:54 [auto1.de] INFO: Found listing with ID: DV89701
2026-03-29 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV89701%27 HTTP/1.1" 200 None
2026-03-29 10:40:54 [auto1.de] INFO: Scrape type for DV89701: 0
2026-03-29 10:40:54 [auto1.de] INFO: Found listing with ID: CS13699
2026-03-29 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS13699%27 HTTP/1.1" 200 None
2026-03-29 10:40:54 [auto1.de] INFO: Scrape type for CS13699: 0
2026-03-29 10:40:54 [auto1.de] INFO: Found listing with ID: RP08748
2026-03-29 10:40:54 [auto1.de] INFO: Found listing with ID: CJ06587
2026-03-29 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ06587%27 HTTP/1.1" 200 None
2026-03-29 10:40:54 [auto1.de] INFO: Scrape type for CJ06587: 2
2026-03-29 10:40:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79d23631-b92a-58d3-be70-1118a41d2688 with identifier: CJ06587
2026-03-29 10:40:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79d23631-b92a-58d3-be70-1118a41d2688 with scrape type 2
2026-03-29 10:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79d23631-b92a-58d3-be70-1118a41d2688 with scrape type 2
2026-03-29 10:40:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79d23631-b92a-58d3-be70-1118a41d2688, identifier: CJ06587
2026-03-29 10:40:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79d23631-b92a-58d3-be70-1118a41d2688 with identifier: CJ06587
2026-03-29 10:40:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79d23631-b92a-58d3-be70-1118a41d2688 with identifier: CJ06587
2026-03-29 10:40:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79d23631-b92a-58d3-be70-1118a41d2688 with identifier: CJ06587 to the API
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:40:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:50:08Z',
 'fuel_type': 'petrol',
 'id': '79d23631-b92a-58d3-be70-1118a41d2688',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ06587',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 222505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-15',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2017}
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ06587%27 HTTP/1.1" 200 None
2026-03-29 10:40:55 [auto1.de] INFO: Saving data for CJ06587: {'auction_closing_time': 1774885808.0, 'created_time': 1773861586.340075, 'last_price_update_time': 1774780855.369973}
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CJ06587') HTTP/1.1" 204 0
2026-03-29 10:40:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: SM94434
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM94434%27 HTTP/1.1" 200 None
2026-03-29 10:40:55 [auto1.de] INFO: Scrape type for SM94434: 0
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: WJ35504
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ35504%27 HTTP/1.1" 200 None
2026-03-29 10:40:55 [auto1.de] INFO: Scrape type for WJ35504: 0
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: AU29418
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: TK51417
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: VH78915
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: WC13471
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: CL03732
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL03732%27 HTTP/1.1" 200 None
2026-03-29 10:40:55 [auto1.de] INFO: Scrape type for CL03732: 0
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: ER72643
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER72643%27 HTTP/1.1" 200 None
2026-03-29 10:40:55 [auto1.de] INFO: Scrape type for ER72643: 0
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: AL51386
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: WG78527
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: PX80115
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX80115%27 HTTP/1.1" 200 None
2026-03-29 10:40:55 [auto1.de] INFO: Scrape type for PX80115: 0
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: BR96483
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: FT78842
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT78842%27 HTTP/1.1" 200 None
2026-03-29 10:40:55 [auto1.de] INFO: Scrape type for FT78842: 0
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: YW76305
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW76305%27 HTTP/1.1" 200 None
2026-03-29 10:40:55 [auto1.de] INFO: Scrape type for YW76305: 0
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: JD98482
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: XE32981
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE32981%27 HTTP/1.1" 200 None
2026-03-29 10:40:55 [auto1.de] INFO: Scrape type for XE32981: 0
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: RJ10234
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ10234%27 HTTP/1.1" 200 None
2026-03-29 10:40:55 [auto1.de] INFO: Scrape type for RJ10234: 0
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: GU49323
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU49323%27 HTTP/1.1" 200 None
2026-03-29 10:40:55 [auto1.de] INFO: Scrape type for GU49323: 0
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: PU73268
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU73268%27 HTTP/1.1" 200 None
2026-03-29 10:40:55 [auto1.de] INFO: Scrape type for PU73268: 0
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: LL88784
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: PR23937
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR23937%27 HTTP/1.1" 200 None
2026-03-29 10:40:55 [auto1.de] INFO: Scrape type for PR23937: 0
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: NW77024
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: VZ53815
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ53815%27 HTTP/1.1" 200 None
2026-03-29 10:40:55 [auto1.de] INFO: Scrape type for VZ53815: 0
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: VE44500
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: FC74080
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC74080%27 HTTP/1.1" 200 None
2026-03-29 10:40:55 [auto1.de] INFO: Scrape type for FC74080: 0
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: NR72053
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: HK68029
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: HH54065
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH54065%27 HTTP/1.1" 200 None
2026-03-29 10:40:55 [auto1.de] INFO: Scrape type for HH54065: 0
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: VJ43142
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ43142%27 HTTP/1.1" 200 None
2026-03-29 10:40:55 [auto1.de] INFO: Scrape type for VJ43142: 0
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: NZ91667
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ91667%27 HTTP/1.1" 200 None
2026-03-29 10:40:55 [auto1.de] INFO: Scrape type for NZ91667: 0
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: GZ30709
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: AY94594
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY94594%27 HTTP/1.1" 200 None
2026-03-29 10:40:55 [auto1.de] INFO: Scrape type for AY94594: 0
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: WP61796
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: NC82982
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: VZ19342
2026-03-29 10:40:55 [auto1.de] INFO: Found listing with ID: PV97095
2026-03-29 10:40:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:40:59 [auto1.de] INFO: Channel: 24h | Page: 87 | totalHits: 6726 | hits on page: 40
2026-03-29 10:40:59 [auto1.de] INFO: Found listing with ID: GE56014
2026-03-29 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE56014%27 HTTP/1.1" 200 None
2026-03-29 10:40:59 [auto1.de] INFO: Scrape type for GE56014: 0
2026-03-29 10:40:59 [auto1.de] INFO: Found listing with ID: WB73740
2026-03-29 10:40:59 [auto1.de] INFO: Found listing with ID: KY92219
2026-03-29 10:40:59 [auto1.de] INFO: Found listing with ID: GH57189
2026-03-29 10:40:59 [auto1.de] INFO: Found listing with ID: VC01658
2026-03-29 10:40:59 [auto1.de] INFO: Found listing with ID: DW77915
2026-03-29 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW77915%27 HTTP/1.1" 200 None
2026-03-29 10:40:59 [auto1.de] INFO: Scrape type for DW77915: 0
2026-03-29 10:40:59 [auto1.de] INFO: Found listing with ID: AU27688
2026-03-29 10:40:59 [auto1.de] INFO: Found listing with ID: EN93789
2026-03-29 10:40:59 [auto1.de] INFO: Found listing with ID: HK20534
2026-03-29 10:40:59 [auto1.de] INFO: Found listing with ID: AT78165
2026-03-29 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT78165%27 HTTP/1.1" 200 None
2026-03-29 10:40:59 [auto1.de] INFO: Scrape type for AT78165: 0
2026-03-29 10:40:59 [auto1.de] INFO: Found listing with ID: ZB00511
2026-03-29 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB00511%27 HTTP/1.1" 200 None
2026-03-29 10:40:59 [auto1.de] INFO: Scrape type for ZB00511: 0
2026-03-29 10:40:59 [auto1.de] INFO: Found listing with ID: RS80830
2026-03-29 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS80830%27 HTTP/1.1" 200 None
2026-03-29 10:40:59 [auto1.de] INFO: Scrape type for RS80830: 0
2026-03-29 10:40:59 [auto1.de] INFO: Found listing with ID: UA00536
2026-03-29 10:40:59 [auto1.de] INFO: Found listing with ID: LK12622
2026-03-29 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK12622%27 HTTP/1.1" 200 None
2026-03-29 10:40:59 [auto1.de] INFO: Scrape type for LK12622: 0
2026-03-29 10:40:59 [auto1.de] INFO: Found listing with ID: PY52590
2026-03-29 10:40:59 [auto1.de] INFO: Found listing with ID: BB78660
2026-03-29 10:40:59 [auto1.de] INFO: Found listing with ID: YA95886
2026-03-29 10:40:59 [auto1.de] INFO: Found listing with ID: ZR01639
2026-03-29 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR01639%27 HTTP/1.1" 200 None
2026-03-29 10:40:59 [auto1.de] INFO: Scrape type for ZR01639: 0
2026-03-29 10:40:59 [auto1.de] INFO: Found listing with ID: TL72332
2026-03-29 10:40:59 [auto1.de] INFO: Found listing with ID: VN50855
2026-03-29 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN50855%27 HTTP/1.1" 200 None
2026-03-29 10:40:59 [auto1.de] INFO: Scrape type for VN50855: 0
2026-03-29 10:40:59 [auto1.de] INFO: Found listing with ID: HR89143
2026-03-29 10:40:59 [auto1.de] INFO: Found listing with ID: LC37503
2026-03-29 10:40:59 [auto1.de] INFO: Found listing with ID: WC31038
2026-03-29 10:40:59 [auto1.de] INFO: Found listing with ID: AB73354
2026-03-29 10:40:59 [auto1.de] INFO: Found listing with ID: ZN20945
2026-03-29 10:40:59 [auto1.de] INFO: Found listing with ID: ZT78140
2026-03-29 10:40:59 [auto1.de] INFO: Found listing with ID: JU52980
2026-03-29 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU52980%27 HTTP/1.1" 200 None
2026-03-29 10:40:59 [auto1.de] INFO: Scrape type for JU52980: 0
2026-03-29 10:40:59 [auto1.de] INFO: Found listing with ID: DW68578
2026-03-29 10:40:59 [auto1.de] INFO: Found listing with ID: WW16724
2026-03-29 10:40:59 [auto1.de] INFO: Found listing with ID: CM78973
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM78973%27 HTTP/1.1" 200 None
2026-03-29 10:41:00 [auto1.de] INFO: Scrape type for CM78973: 0
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: JT86021
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: EX22671
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX22671%27 HTTP/1.1" 200 None
2026-03-29 10:41:00 [auto1.de] INFO: Scrape type for EX22671: 0
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: MY70814
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: PP25437
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP25437%27 HTTP/1.1" 200 None
2026-03-29 10:41:00 [auto1.de] INFO: Scrape type for PP25437: 0
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: LK50983
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: TT40648
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT40648%27 HTTP/1.1" 200 None
2026-03-29 10:41:00 [auto1.de] INFO: Scrape type for TT40648: 0
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: HV45616
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV45616%27 HTTP/1.1" 200 None
2026-03-29 10:41:00 [auto1.de] INFO: Scrape type for HV45616: 0
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: PJ38214
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: XE19125
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE19125%27 HTTP/1.1" 200 None
2026-03-29 10:41:00 [auto1.de] INFO: Scrape type for XE19125: 0
2026-03-29 10:41:00 [auto1.de] INFO: Found listing with ID: TJ20795
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ20795%27 HTTP/1.1" 200 None
2026-03-29 10:41:00 [auto1.de] INFO: Scrape type for TJ20795: 0
2026-03-29 10:41:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:41:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:41:04 [auto1.de] INFO: Channel: 24h | Page: 88 | totalHits: 6726 | hits on page: 40
2026-03-29 10:41:04 [auto1.de] INFO: Found listing with ID: SE52893
2026-03-29 10:41:04 [auto1.de] INFO: Found listing with ID: GN10929
2026-03-29 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN10929%27 HTTP/1.1" 200 None
2026-03-29 10:41:04 [auto1.de] INFO: Scrape type for GN10929: 0
2026-03-29 10:41:04 [auto1.de] INFO: Found listing with ID: BD92301
2026-03-29 10:41:04 [auto1.de] INFO: Found listing with ID: YE66083
2026-03-29 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE66083%27 HTTP/1.1" 200 None
2026-03-29 10:41:04 [auto1.de] INFO: Scrape type for YE66083: 0
2026-03-29 10:41:04 [auto1.de] INFO: Found listing with ID: TX48260
2026-03-29 10:41:04 [auto1.de] INFO: Found listing with ID: TL90122
2026-03-29 10:41:04 [auto1.de] INFO: Found listing with ID: AK08323
2026-03-29 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK08323%27 HTTP/1.1" 200 None
2026-03-29 10:41:04 [auto1.de] INFO: Scrape type for AK08323: 0
2026-03-29 10:41:04 [auto1.de] INFO: Found listing with ID: GW69862
2026-03-29 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW69862%27 HTTP/1.1" 200 None
2026-03-29 10:41:04 [auto1.de] INFO: Scrape type for GW69862: 0
2026-03-29 10:41:04 [auto1.de] INFO: Found listing with ID: KZ61437
2026-03-29 10:41:04 [auto1.de] INFO: Found listing with ID: AW78451
2026-03-29 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW78451%27 HTTP/1.1" 200 None
2026-03-29 10:41:04 [auto1.de] INFO: Scrape type for AW78451: 0
2026-03-29 10:41:04 [auto1.de] INFO: Found listing with ID: ZG14470
2026-03-29 10:41:04 [auto1.de] INFO: Found listing with ID: NE74286
2026-03-29 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE74286%27 HTTP/1.1" 200 None
2026-03-29 10:41:04 [auto1.de] INFO: Scrape type for NE74286: 0
2026-03-29 10:41:04 [auto1.de] INFO: Found listing with ID: AK47916
2026-03-29 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK47916%27 HTTP/1.1" 200 None
2026-03-29 10:41:04 [auto1.de] INFO: Scrape type for AK47916: 0
2026-03-29 10:41:04 [auto1.de] INFO: Found listing with ID: JW24568
2026-03-29 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW24568%27 HTTP/1.1" 200 None
2026-03-29 10:41:04 [auto1.de] INFO: Scrape type for JW24568: 0
2026-03-29 10:41:04 [auto1.de] INFO: Found listing with ID: WZ19127
2026-03-29 10:41:04 [auto1.de] INFO: Found listing with ID: ZR21062
2026-03-29 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR21062%27 HTTP/1.1" 200 None
2026-03-29 10:41:05 [auto1.de] INFO: Scrape type for ZR21062: 0
2026-03-29 10:41:05 [auto1.de] INFO: Found listing with ID: ZC43990
2026-03-29 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC43990%27 HTTP/1.1" 200 None
2026-03-29 10:41:05 [auto1.de] INFO: Scrape type for ZC43990: 0
2026-03-29 10:41:05 [auto1.de] INFO: Found listing with ID: RB25738
2026-03-29 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB25738%27 HTTP/1.1" 200 None
2026-03-29 10:41:05 [auto1.de] INFO: Scrape type for RB25738: 0
2026-03-29 10:41:05 [auto1.de] INFO: Found listing with ID: PH16330
2026-03-29 10:41:05 [auto1.de] INFO: Found listing with ID: WV70498
2026-03-29 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV70498%27 HTTP/1.1" 200 None
2026-03-29 10:41:05 [auto1.de] INFO: Scrape type for WV70498: 0
2026-03-29 10:41:05 [auto1.de] INFO: Found listing with ID: ZH23061
2026-03-29 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH23061%27 HTTP/1.1" 200 None
2026-03-29 10:41:05 [auto1.de] INFO: Scrape type for ZH23061: 0
2026-03-29 10:41:05 [auto1.de] INFO: Found listing with ID: KM72305
2026-03-29 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM72305%27 HTTP/1.1" 200 None
2026-03-29 10:41:05 [auto1.de] INFO: Scrape type for KM72305: 0
2026-03-29 10:41:05 [auto1.de] INFO: Found listing with ID: CT44889
2026-03-29 10:41:05 [auto1.de] INFO: Found listing with ID: KL19137
2026-03-29 10:41:05 [auto1.de] INFO: Found listing with ID: AV62833
2026-03-29 10:41:05 [auto1.de] INFO: Found listing with ID: RZ33260
2026-03-29 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ33260%27 HTTP/1.1" 200 None
2026-03-29 10:41:05 [auto1.de] INFO: Scrape type for RZ33260: 0
2026-03-29 10:41:05 [auto1.de] INFO: Found listing with ID: PA63751
2026-03-29 10:41:05 [auto1.de] INFO: Found listing with ID: FX17488
2026-03-29 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX17488%27 HTTP/1.1" 200 None
2026-03-29 10:41:05 [auto1.de] INFO: Scrape type for FX17488: 0
2026-03-29 10:41:05 [auto1.de] INFO: Found listing with ID: LC63229
2026-03-29 10:41:05 [auto1.de] INFO: Found listing with ID: DW05211
2026-03-29 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW05211%27 HTTP/1.1" 200 None
2026-03-29 10:41:05 [auto1.de] INFO: Scrape type for DW05211: 0
2026-03-29 10:41:05 [auto1.de] INFO: Found listing with ID: AA98436
2026-03-29 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA98436%27 HTTP/1.1" 200 None
2026-03-29 10:41:05 [auto1.de] INFO: Scrape type for AA98436: 0
2026-03-29 10:41:05 [auto1.de] INFO: Found listing with ID: AM41961
2026-03-29 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM41961%27 HTTP/1.1" 200 None
2026-03-29 10:41:05 [auto1.de] INFO: Scrape type for AM41961: 0
2026-03-29 10:41:05 [auto1.de] INFO: Found listing with ID: PU94869
2026-03-29 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU94869%27 HTTP/1.1" 200 None
2026-03-29 10:41:05 [auto1.de] INFO: Scrape type for PU94869: 0
2026-03-29 10:41:05 [auto1.de] INFO: Found listing with ID: WG01413
2026-03-29 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG01413%27 HTTP/1.1" 200 None
2026-03-29 10:41:05 [auto1.de] INFO: Scrape type for WG01413: 0
2026-03-29 10:41:05 [auto1.de] INFO: Found listing with ID: TW05581
2026-03-29 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW05581%27 HTTP/1.1" 200 None
2026-03-29 10:41:05 [auto1.de] INFO: Scrape type for TW05581: 0
2026-03-29 10:41:05 [auto1.de] INFO: Found listing with ID: RS45157
2026-03-29 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS45157%27 HTTP/1.1" 200 None
2026-03-29 10:41:05 [auto1.de] INFO: Scrape type for RS45157: 0
2026-03-29 10:41:05 [auto1.de] INFO: Found listing with ID: SN72199
2026-03-29 10:41:05 [auto1.de] INFO: Found listing with ID: WC63339
2026-03-29 10:41:05 [auto1.de] INFO: Found listing with ID: YJ03455
2026-03-29 10:41:05 [auto1.de] INFO: Found listing with ID: UP84428
2026-03-29 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP84428%27 HTTP/1.1" 200 None
2026-03-29 10:41:05 [auto1.de] INFO: Scrape type for UP84428: 0
2026-03-29 10:41:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:41:06 [scrapy.extensions.logstats] INFO: Crawled 150 pages (at 7 pages/min), scraped 242 items (at 2 items/min)
2026-03-29 10:41:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 160MiB
2026-03-29 10:41:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:41:07 [auto1.de] INFO: Channel: 24h | Page: 89 | totalHits: 6726 | hits on page: 40
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: VL43028
2026-03-29 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL43028%27 HTTP/1.1" 200 None
2026-03-29 10:41:07 [auto1.de] INFO: Scrape type for VL43028: 0
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: YY60165
2026-03-29 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY60165%27 HTTP/1.1" 200 None
2026-03-29 10:41:07 [auto1.de] INFO: Scrape type for YY60165: 0
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: XU86679
2026-03-29 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU86679%27 HTTP/1.1" 200 None
2026-03-29 10:41:07 [auto1.de] INFO: Scrape type for XU86679: 0
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: PZ40966
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: MV46012
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: MX17219
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: EJ74150
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: VJ29661
2026-03-29 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ29661%27 HTTP/1.1" 200 None
2026-03-29 10:41:07 [auto1.de] INFO: Scrape type for VJ29661: 0
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: EL67777
2026-03-29 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL67777%27 HTTP/1.1" 200 None
2026-03-29 10:41:07 [auto1.de] INFO: Scrape type for EL67777: 0
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: HL95475
2026-03-29 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL95475%27 HTTP/1.1" 200 None
2026-03-29 10:41:07 [auto1.de] INFO: Scrape type for HL95475: 0
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: UX48590
2026-03-29 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX48590%27 HTTP/1.1" 200 None
2026-03-29 10:41:07 [auto1.de] INFO: Scrape type for UX48590: 0
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: SN47860
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: FF11378
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: LN92590
2026-03-29 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN92590%27 HTTP/1.1" 200 None
2026-03-29 10:41:07 [auto1.de] INFO: Scrape type for LN92590: 0
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: HZ32658
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: NG52240
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: KD58874
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: WF56073
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: SG53147
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: RB75427
2026-03-29 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB75427%27 HTTP/1.1" 200 None
2026-03-29 10:41:07 [auto1.de] INFO: Scrape type for RB75427: 0
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: HJ09616
2026-03-29 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ09616%27 HTTP/1.1" 200 None
2026-03-29 10:41:07 [auto1.de] INFO: Scrape type for HJ09616: 0
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: WF31302
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: UR24224
2026-03-29 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR24224%27 HTTP/1.1" 200 None
2026-03-29 10:41:07 [auto1.de] INFO: Scrape type for UR24224: 0
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: VW19119
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: SG45396
2026-03-29 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG45396%27 HTTP/1.1" 200 None
2026-03-29 10:41:07 [auto1.de] INFO: Scrape type for SG45396: 0
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: GP68218
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: TP00598
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: YB86869
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: XB50161
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: NF34057
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: SV23538
2026-03-29 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV23538%27 HTTP/1.1" 200 None
2026-03-29 10:41:07 [auto1.de] INFO: Scrape type for SV23538: 0
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: LD63476
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: WY73016
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: MD44435
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: XJ62576
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: EJ80862
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: HL19525
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: ZV33449
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: XH15947
2026-03-29 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH15947%27 HTTP/1.1" 200 None
2026-03-29 10:41:07 [auto1.de] INFO: Scrape type for XH15947: 0
2026-03-29 10:41:07 [auto1.de] INFO: Found listing with ID: FJ78766
2026-03-29 10:41:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:41:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:41:12 [auto1.de] INFO: Channel: 24h | Page: 90 | totalHits: 6726 | hits on page: 40
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: BS22515
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: AE64290
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: LK47364
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK47364%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for LK47364: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: DE54360
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE54360%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for DE54360: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: GK43362
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: HA43424
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA43424%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for HA43424: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: EZ85797
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: CE85756
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE85756%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for CE85756: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: NL88078
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: ET35150
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: ZC46474
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC46474%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for ZC46474: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: WS02487
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: AK86210
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK86210%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for AK86210: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: TP63810
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP63810%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for TP63810: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: XJ24379
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ24379%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for XJ24379: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: CW19006
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: NV33173
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: WZ35506
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ35506%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for WZ35506: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: SA55190
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: CV81199
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV81199%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for CV81199: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: WN39495
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN39495%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for WN39495: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: JA72326
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA72326%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for JA72326: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: XV42513
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV42513%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for XV42513: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: CL87720
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL87720%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for CL87720: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: GD49252
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD49252%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for GD49252: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: PF96299
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: NV88353
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV88353%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for NV88353: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: EZ94089
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: BX05285
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: XF94363
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF94363%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for XF94363: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: HC04240
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC04240%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for HC04240: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: KU16473
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: CK46360
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK46360%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for CK46360: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: CS93004
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS93004%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for CS93004: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: SD16829
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD16829%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for SD16829: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: KF41308
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF41308%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for KF41308: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: JX81073
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: FD22353
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD22353%27 HTTP/1.1" 200 None
2026-03-29 10:41:12 [auto1.de] INFO: Scrape type for FD22353: 0
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: JX40120
2026-03-29 10:41:12 [auto1.de] INFO: Found listing with ID: VN30485
2026-03-29 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN30485%27 HTTP/1.1" 200 None
2026-03-29 10:41:13 [auto1.de] INFO: Scrape type for VN30485: 0
2026-03-29 10:41:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:41:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:41:21 [auto1.de] INFO: Channel: 24h | Page: 91 | totalHits: 6726 | hits on page: 40
2026-03-29 10:41:21 [auto1.de] INFO: Found listing with ID: LK64393
2026-03-29 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK64393%27 HTTP/1.1" 200 None
2026-03-29 10:41:21 [auto1.de] INFO: Scrape type for LK64393: 0
2026-03-29 10:41:21 [auto1.de] INFO: Found listing with ID: PL78300
2026-03-29 10:41:21 [auto1.de] INFO: Found listing with ID: KD34962
2026-03-29 10:41:21 [auto1.de] INFO: Found listing with ID: SD36670
2026-03-29 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD36670%27 HTTP/1.1" 200 None
2026-03-29 10:41:21 [auto1.de] INFO: Scrape type for SD36670: 2
2026-03-29 10:41:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf864095-e21b-5b8c-8e3c-8cf392cd4f28 with identifier: SD36670
2026-03-29 10:41:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf864095-e21b-5b8c-8e3c-8cf392cd4f28 with scrape type 2
2026-03-29 10:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf864095-e21b-5b8c-8e3c-8cf392cd4f28 with scrape type 2
2026-03-29 10:41:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf864095-e21b-5b8c-8e3c-8cf392cd4f28, identifier: SD36670
2026-03-29 10:41:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf864095-e21b-5b8c-8e3c-8cf392cd4f28 with identifier: SD36670
2026-03-29 10:41:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf864095-e21b-5b8c-8e3c-8cf392cd4f28 with identifier: SD36670
2026-03-29 10:41:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf864095-e21b-5b8c-8e3c-8cf392cd4f28 with identifier: SD36670 to the API
2026-03-29 10:41:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:41:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:48:02Z',
 'fuel_type': 'diesel',
 'id': 'cf864095-e21b-5b8c-8e3c-8cf392cd4f28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD36670',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 121993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-21',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2018}
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD36670%27 HTTP/1.1" 200 None
2026-03-29 10:41:22 [auto1.de] INFO: Saving data for SD36670: {'auction_closing_time': 1774885682.0, 'created_time': 1774034543.25496, 'last_price_update_time': 1774780882.114067}
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD36670') HTTP/1.1" 204 0
2026-03-29 10:41:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: WE98596
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE98596%27 HTTP/1.1" 200 None
2026-03-29 10:41:22 [auto1.de] INFO: Scrape type for WE98596: 0
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: ES44709
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: AJ62547
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ62547%27 HTTP/1.1" 200 None
2026-03-29 10:41:22 [auto1.de] INFO: Scrape type for AJ62547: 0
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: YE69852
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: AW80803
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW80803%27 HTTP/1.1" 200 None
2026-03-29 10:41:22 [auto1.de] INFO: Scrape type for AW80803: 0
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: BH52991
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH52991%27 HTTP/1.1" 200 None
2026-03-29 10:41:22 [auto1.de] INFO: Scrape type for BH52991: 0
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: GU66110
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU66110%27 HTTP/1.1" 200 None
2026-03-29 10:41:22 [auto1.de] INFO: Scrape type for GU66110: 0
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: GM59339
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: PT90816
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: AL23415
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL23415%27 HTTP/1.1" 200 None
2026-03-29 10:41:22 [auto1.de] INFO: Scrape type for AL23415: 0
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: VS72441
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: JE81559
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: KY72629
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY72629%27 HTTP/1.1" 200 None
2026-03-29 10:41:22 [auto1.de] INFO: Scrape type for KY72629: 0
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: ND35935
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: ME89657
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME89657%27 HTTP/1.1" 200 None
2026-03-29 10:41:22 [auto1.de] INFO: Scrape type for ME89657: 0
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: HU29731
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: GJ05712
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ05712%27 HTTP/1.1" 200 None
2026-03-29 10:41:22 [auto1.de] INFO: Scrape type for GJ05712: 0
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: TT27495
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT27495%27 HTTP/1.1" 200 None
2026-03-29 10:41:22 [auto1.de] INFO: Scrape type for TT27495: 0
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: AM19734
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: ZM99082
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM99082%27 HTTP/1.1" 200 None
2026-03-29 10:41:22 [auto1.de] INFO: Scrape type for ZM99082: 0
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: FJ59032
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ59032%27 HTTP/1.1" 200 None
2026-03-29 10:41:22 [auto1.de] INFO: Scrape type for FJ59032: 0
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: MA76308
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: UZ52700
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: XC25059
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: BD50097
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD50097%27 HTTP/1.1" 200 None
2026-03-29 10:41:22 [auto1.de] INFO: Scrape type for BD50097: 0
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: LM85601
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM85601%27 HTTP/1.1" 200 None
2026-03-29 10:41:22 [auto1.de] INFO: Scrape type for LM85601: 0
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: PS82659
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: XU55815
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU55815%27 HTTP/1.1" 200 None
2026-03-29 10:41:22 [auto1.de] INFO: Scrape type for XU55815: 0
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: FG98454
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG98454%27 HTTP/1.1" 200 None
2026-03-29 10:41:22 [auto1.de] INFO: Scrape type for FG98454: 0
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: CD03678
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD03678%27 HTTP/1.1" 200 None
2026-03-29 10:41:22 [auto1.de] INFO: Scrape type for CD03678: 0
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: YX31470
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX31470%27 HTTP/1.1" 200 None
2026-03-29 10:41:22 [auto1.de] INFO: Scrape type for YX31470: 0
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: EC14916
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC14916%27 HTTP/1.1" 200 None
2026-03-29 10:41:22 [auto1.de] INFO: Scrape type for EC14916: 0
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: TX40216
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: NH67676
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: LX22574
2026-03-29 10:41:22 [auto1.de] INFO: Found listing with ID: FP02134
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP02134%27 HTTP/1.1" 200 None
2026-03-29 10:41:22 [auto1.de] INFO: Scrape type for FP02134: 0
2026-03-29 10:41:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:41:30 [auto1.de] INFO: Channel: 24h | Page: 92 | totalHits: 6726 | hits on page: 40
2026-03-29 10:41:30 [auto1.de] INFO: Found listing with ID: DJ81890
2026-03-29 10:41:30 [auto1.de] INFO: Found listing with ID: AD30182
2026-03-29 10:41:30 [auto1.de] INFO: Found listing with ID: MK08111
2026-03-29 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK08111%27 HTTP/1.1" 200 None
2026-03-29 10:41:30 [auto1.de] INFO: Scrape type for MK08111: 0
2026-03-29 10:41:30 [auto1.de] INFO: Found listing with ID: UE87725
2026-03-29 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE87725%27 HTTP/1.1" 200 None
2026-03-29 10:41:30 [auto1.de] INFO: Scrape type for UE87725: 0
2026-03-29 10:41:30 [auto1.de] INFO: Found listing with ID: TJ52961
2026-03-29 10:41:30 [auto1.de] INFO: Found listing with ID: LV52918
2026-03-29 10:41:30 [auto1.de] INFO: Found listing with ID: NC46979
2026-03-29 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC46979%27 HTTP/1.1" 200 None
2026-03-29 10:41:30 [auto1.de] INFO: Scrape type for NC46979: 0
2026-03-29 10:41:30 [auto1.de] INFO: Found listing with ID: PW08848
2026-03-29 10:41:30 [auto1.de] INFO: Found listing with ID: YL92844
2026-03-29 10:41:30 [auto1.de] INFO: Found listing with ID: XC92552
2026-03-29 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC92552%27 HTTP/1.1" 200 None
2026-03-29 10:41:30 [auto1.de] INFO: Scrape type for XC92552: 0
2026-03-29 10:41:30 [auto1.de] INFO: Found listing with ID: UC42370
2026-03-29 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC42370%27 HTTP/1.1" 200 None
2026-03-29 10:41:30 [auto1.de] INFO: Scrape type for UC42370: 0
2026-03-29 10:41:30 [auto1.de] INFO: Found listing with ID: CK27476
2026-03-29 10:41:30 [auto1.de] INFO: Found listing with ID: LN34178
2026-03-29 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN34178%27 HTTP/1.1" 200 None
2026-03-29 10:41:30 [auto1.de] INFO: Scrape type for LN34178: 0
2026-03-29 10:41:30 [auto1.de] INFO: Found listing with ID: WV16405
2026-03-29 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV16405%27 HTTP/1.1" 200 None
2026-03-29 10:41:30 [auto1.de] INFO: Scrape type for WV16405: 0
2026-03-29 10:41:30 [auto1.de] INFO: Found listing with ID: AN68791
2026-03-29 10:41:30 [auto1.de] INFO: Found listing with ID: BT49963
2026-03-29 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT49963%27 HTTP/1.1" 200 None
2026-03-29 10:41:30 [auto1.de] INFO: Scrape type for BT49963: 0
2026-03-29 10:41:30 [auto1.de] INFO: Found listing with ID: SP68179
2026-03-29 10:41:30 [auto1.de] INFO: Found listing with ID: SA68147
2026-03-29 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA68147%27 HTTP/1.1" 200 None
2026-03-29 10:41:30 [auto1.de] INFO: Scrape type for SA68147: 0
2026-03-29 10:41:30 [auto1.de] INFO: Found listing with ID: NT27416
2026-03-29 10:41:30 [auto1.de] INFO: Found listing with ID: TY58494
2026-03-29 10:41:30 [auto1.de] INFO: Found listing with ID: PR32105
2026-03-29 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR32105%27 HTTP/1.1" 200 None
2026-03-29 10:41:30 [auto1.de] INFO: Scrape type for PR32105: 2
2026-03-29 10:41:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2ae2633-7f7c-5226-9c76-fec2d42174fc with identifier: PR32105
2026-03-29 10:41:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2ae2633-7f7c-5226-9c76-fec2d42174fc with scrape type 2
2026-03-29 10:41:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2ae2633-7f7c-5226-9c76-fec2d42174fc with scrape type 2
2026-03-29 10:41:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2ae2633-7f7c-5226-9c76-fec2d42174fc, identifier: PR32105
2026-03-29 10:41:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2ae2633-7f7c-5226-9c76-fec2d42174fc with identifier: PR32105
2026-03-29 10:41:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2ae2633-7f7c-5226-9c76-fec2d42174fc with identifier: PR32105
2026-03-29 10:41:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2ae2633-7f7c-5226-9c76-fec2d42174fc with identifier: PR32105 to the API
2026-03-29 10:41:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:41:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:41:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:21:44Z',
 'fuel_type': 'diesel',
 'id': 'c2ae2633-7f7c-5226-9c76-fec2d42174fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR32105',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 138160,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-13',
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi Allure L1',
 'transmission': 'manual',
 'trim': 'Allure L1',
 'year': 2020}
2026-03-29 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR32105%27 HTTP/1.1" 200 None
2026-03-29 10:41:30 [auto1.de] INFO: Saving data for PR32105: {'auction_closing_time': 1774884104.0, 'created_time': 1774350285.186869, 'last_price_update_time': 1774780890.95136}
2026-03-29 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PR32105') HTTP/1.1" 204 0
2026-03-29 10:41:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:41:31 [auto1.de] INFO: Found listing with ID: UM48488
2026-03-29 10:41:31 [auto1.de] INFO: Found listing with ID: WC33817
2026-03-29 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC33817%27 HTTP/1.1" 200 None
2026-03-29 10:41:31 [auto1.de] INFO: Scrape type for WC33817: 0
2026-03-29 10:41:31 [auto1.de] INFO: Found listing with ID: CD36674
2026-03-29 10:41:31 [auto1.de] INFO: Found listing with ID: EU37880
2026-03-29 10:41:31 [auto1.de] INFO: Found listing with ID: PB35717
2026-03-29 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB35717%27 HTTP/1.1" 200 None
2026-03-29 10:41:31 [auto1.de] INFO: Scrape type for PB35717: 0
2026-03-29 10:41:31 [auto1.de] INFO: Found listing with ID: MP89368
2026-03-29 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP89368%27 HTTP/1.1" 200 None
2026-03-29 10:41:31 [auto1.de] INFO: Scrape type for MP89368: 0
2026-03-29 10:41:31 [auto1.de] INFO: Found listing with ID: PV26171
2026-03-29 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV26171%27 HTTP/1.1" 200 None
2026-03-29 10:41:31 [auto1.de] INFO: Scrape type for PV26171: 0
2026-03-29 10:41:31 [auto1.de] INFO: Found listing with ID: FX08537
2026-03-29 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX08537%27 HTTP/1.1" 200 None
2026-03-29 10:41:31 [auto1.de] INFO: Scrape type for FX08537: 0
2026-03-29 10:41:31 [auto1.de] INFO: Found listing with ID: RW84791
2026-03-29 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW84791%27 HTTP/1.1" 200 None
2026-03-29 10:41:31 [auto1.de] INFO: Scrape type for RW84791: 0
2026-03-29 10:41:31 [auto1.de] INFO: Found listing with ID: VB58565
2026-03-29 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB58565%27 HTTP/1.1" 200 None
2026-03-29 10:41:31 [auto1.de] INFO: Scrape type for VB58565: 0
2026-03-29 10:41:31 [auto1.de] INFO: Found listing with ID: NW62126
2026-03-29 10:41:31 [auto1.de] INFO: Found listing with ID: SK54405
2026-03-29 10:41:31 [auto1.de] INFO: Found listing with ID: EK27182
2026-03-29 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK27182%27 HTTP/1.1" 200 None
2026-03-29 10:41:31 [auto1.de] INFO: Scrape type for EK27182: 0
2026-03-29 10:41:31 [auto1.de] INFO: Found listing with ID: JG35044
2026-03-29 10:41:31 [auto1.de] INFO: Found listing with ID: BW05751
2026-03-29 10:41:31 [auto1.de] INFO: Found listing with ID: ZJ06184
2026-03-29 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ06184%27 HTTP/1.1" 200 None
2026-03-29 10:41:31 [auto1.de] INFO: Scrape type for ZJ06184: 0
2026-03-29 10:41:31 [auto1.de] INFO: Found listing with ID: MS67551
2026-03-29 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS67551%27 HTTP/1.1" 200 None
2026-03-29 10:41:31 [auto1.de] INFO: Scrape type for MS67551: 0
2026-03-29 10:41:31 [auto1.de] INFO: Found listing with ID: BU48960
2026-03-29 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU48960%27 HTTP/1.1" 200 None
2026-03-29 10:41:31 [auto1.de] INFO: Scrape type for BU48960: 0
2026-03-29 10:41:31 [auto1.de] INFO: Found listing with ID: NL59666
2026-03-29 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL59666%27 HTTP/1.1" 200 None
2026-03-29 10:41:31 [auto1.de] INFO: Scrape type for NL59666: 0
2026-03-29 10:41:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:41:41 [auto1.de] INFO: Channel: 24h | Page: 93 | totalHits: 6726 | hits on page: 40
2026-03-29 10:41:41 [auto1.de] INFO: Found listing with ID: MT90802
2026-03-29 10:41:41 [auto1.de] INFO: Found listing with ID: ZW20696
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW20696%27 HTTP/1.1" 200 None
2026-03-29 10:41:42 [auto1.de] INFO: Scrape type for ZW20696: 0
2026-03-29 10:41:42 [auto1.de] INFO: Found listing with ID: ZV40367
2026-03-29 10:41:42 [auto1.de] INFO: Found listing with ID: XG94093
2026-03-29 10:41:42 [auto1.de] INFO: Found listing with ID: RP15707
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP15707%27 HTTP/1.1" 200 None
2026-03-29 10:41:42 [auto1.de] INFO: Scrape type for RP15707: 0
2026-03-29 10:41:42 [auto1.de] INFO: Found listing with ID: SF33056
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF33056%27 HTTP/1.1" 200 None
2026-03-29 10:41:42 [auto1.de] INFO: Scrape type for SF33056: 0
2026-03-29 10:41:42 [auto1.de] INFO: Found listing with ID: ZV16812
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV16812%27 HTTP/1.1" 200 None
2026-03-29 10:41:42 [auto1.de] INFO: Scrape type for ZV16812: 0
2026-03-29 10:41:42 [auto1.de] INFO: Found listing with ID: UY58997
2026-03-29 10:41:42 [auto1.de] INFO: Found listing with ID: CR33136
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR33136%27 HTTP/1.1" 200 None
2026-03-29 10:41:42 [auto1.de] INFO: Scrape type for CR33136: 0
2026-03-29 10:41:42 [auto1.de] INFO: Found listing with ID: SY19126
2026-03-29 10:41:42 [auto1.de] INFO: Found listing with ID: FB95771
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB95771%27 HTTP/1.1" 200 None
2026-03-29 10:41:42 [auto1.de] INFO: Scrape type for FB95771: 0
2026-03-29 10:41:42 [auto1.de] INFO: Found listing with ID: TH26087
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH26087%27 HTTP/1.1" 200 None
2026-03-29 10:41:42 [auto1.de] INFO: Scrape type for TH26087: 0
2026-03-29 10:41:42 [auto1.de] INFO: Found listing with ID: CE31107
2026-03-29 10:41:42 [auto1.de] INFO: Found listing with ID: BN03285
2026-03-29 10:41:42 [auto1.de] INFO: Found listing with ID: EB29224
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB29224%27 HTTP/1.1" 200 None
2026-03-29 10:41:42 [auto1.de] INFO: Scrape type for EB29224: 0
2026-03-29 10:41:42 [auto1.de] INFO: Found listing with ID: KT29520
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT29520%27 HTTP/1.1" 200 None
2026-03-29 10:41:42 [auto1.de] INFO: Scrape type for KT29520: 0
2026-03-29 10:41:42 [auto1.de] INFO: Found listing with ID: MM04684
2026-03-29 10:41:42 [auto1.de] INFO: Found listing with ID: UD17125
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD17125%27 HTTP/1.1" 200 None
2026-03-29 10:41:42 [auto1.de] INFO: Scrape type for UD17125: 0
2026-03-29 10:41:42 [auto1.de] INFO: Found listing with ID: SZ04450
2026-03-29 10:41:42 [auto1.de] INFO: Found listing with ID: KG96622
2026-03-29 10:41:42 [auto1.de] INFO: Found listing with ID: VU07666
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU07666%27 HTTP/1.1" 200 None
2026-03-29 10:41:42 [auto1.de] INFO: Scrape type for VU07666: 0
2026-03-29 10:41:42 [auto1.de] INFO: Found listing with ID: EZ36931
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ36931%27 HTTP/1.1" 200 None
2026-03-29 10:41:42 [auto1.de] INFO: Scrape type for EZ36931: 0
2026-03-29 10:41:42 [auto1.de] INFO: Found listing with ID: JZ27200
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ27200%27 HTTP/1.1" 200 None
2026-03-29 10:41:42 [auto1.de] INFO: Scrape type for JZ27200: 0
2026-03-29 10:41:42 [auto1.de] INFO: Found listing with ID: FN92851
2026-03-29 10:41:42 [auto1.de] INFO: Found listing with ID: HF47887
2026-03-29 10:41:42 [auto1.de] INFO: Found listing with ID: RD90003
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD90003%27 HTTP/1.1" 200 None
2026-03-29 10:41:42 [auto1.de] INFO: Scrape type for RD90003: 0
2026-03-29 10:41:42 [auto1.de] INFO: Found listing with ID: NS17316
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS17316%27 HTTP/1.1" 200 None
2026-03-29 10:41:42 [auto1.de] INFO: Scrape type for NS17316: 0
2026-03-29 10:41:42 [auto1.de] INFO: Found listing with ID: EN47046
2026-03-29 10:41:42 [auto1.de] INFO: Found listing with ID: WP78953
2026-03-29 10:41:42 [auto1.de] INFO: Found listing with ID: EH62859
2026-03-29 10:41:42 [auto1.de] INFO: Found listing with ID: UA79270
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA79270%27 HTTP/1.1" 200 None
2026-03-29 10:41:42 [auto1.de] INFO: Scrape type for UA79270: 0
2026-03-29 10:41:42 [auto1.de] INFO: Found listing with ID: HT34266
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT34266%27 HTTP/1.1" 200 None
2026-03-29 10:41:42 [auto1.de] INFO: Scrape type for HT34266: 0
2026-03-29 10:41:42 [auto1.de] INFO: Found listing with ID: CK62580
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK62580%27 HTTP/1.1" 200 None
2026-03-29 10:41:42 [auto1.de] INFO: Scrape type for CK62580: 0
2026-03-29 10:41:42 [auto1.de] INFO: Found listing with ID: GA34239
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA34239%27 HTTP/1.1" 200 None
2026-03-29 10:41:42 [auto1.de] INFO: Scrape type for GA34239: 2
2026-03-29 10:41:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cba1d9f-aa18-58b4-9a2e-8116d549879f with identifier: GA34239
2026-03-29 10:41:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cba1d9f-aa18-58b4-9a2e-8116d549879f with scrape type 2
2026-03-29 10:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cba1d9f-aa18-58b4-9a2e-8116d549879f with scrape type 2
2026-03-29 10:41:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8cba1d9f-aa18-58b4-9a2e-8116d549879f, identifier: GA34239
2026-03-29 10:41:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8cba1d9f-aa18-58b4-9a2e-8116d549879f with identifier: GA34239
2026-03-29 10:41:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8cba1d9f-aa18-58b4-9a2e-8116d549879f with identifier: GA34239
2026-03-29 10:41:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8cba1d9f-aa18-58b4-9a2e-8116d549879f with identifier: GA34239 to the API
2026-03-29 10:41:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:41:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:41:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:09:47Z',
 'fuel_type': 'diesel',
 'id': '8cba1d9f-aa18-58b4-9a2e-8116d549879f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA34239',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 165456,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-08',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-03-29 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA34239%27 HTTP/1.1" 200 None
2026-03-29 10:41:43 [auto1.de] INFO: Saving data for GA34239: {'auction_closing_time': 1774883387.0, 'created_time': 1774002471.95865, 'last_price_update_time': 1774780903.421116}
2026-03-29 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA34239') HTTP/1.1" 204 0
2026-03-29 10:41:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:41:43 [auto1.de] INFO: Found listing with ID: LS63557
2026-03-29 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS63557%27 HTTP/1.1" 200 None
2026-03-29 10:41:43 [auto1.de] INFO: Scrape type for LS63557: 0
2026-03-29 10:41:43 [auto1.de] INFO: Found listing with ID: ZU57618
2026-03-29 10:41:43 [auto1.de] INFO: Found listing with ID: PR50786
2026-03-29 10:41:43 [auto1.de] INFO: Found listing with ID: AS18464
2026-03-29 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS18464%27 HTTP/1.1" 200 None
2026-03-29 10:41:43 [auto1.de] INFO: Scrape type for AS18464: 0
2026-03-29 10:41:43 [auto1.de] INFO: Found listing with ID: ZJ71499
2026-03-29 10:41:43 [auto1.de] INFO: Found listing with ID: RG74932
2026-03-29 10:41:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:41:44 [auto1.de] INFO: Channel: 24h | Page: 94 | totalHits: 6726 | hits on page: 40
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: MD24708
2026-03-29 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD24708%27 HTTP/1.1" 200 None
2026-03-29 10:41:44 [auto1.de] INFO: Scrape type for MD24708: 0
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: WE68456
2026-03-29 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE68456%27 HTTP/1.1" 200 None
2026-03-29 10:41:44 [auto1.de] INFO: Scrape type for WE68456: 0
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: JH37191
2026-03-29 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH37191%27 HTTP/1.1" 200 None
2026-03-29 10:41:44 [auto1.de] INFO: Scrape type for JH37191: 0
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: BX95848
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: GD48947
2026-03-29 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD48947%27 HTTP/1.1" 200 None
2026-03-29 10:41:44 [auto1.de] INFO: Scrape type for GD48947: 0
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: LX45168
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: DZ36531
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: MV67104
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: GK88230
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: CF55359
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: UU73518
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: XM77164
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: UU35907
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: ZL38204
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: ZY13516
2026-03-29 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY13516%27 HTTP/1.1" 200 None
2026-03-29 10:41:44 [auto1.de] INFO: Scrape type for ZY13516: 0
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: HD14897
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: SB93381
2026-03-29 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB93381%27 HTTP/1.1" 200 None
2026-03-29 10:41:44 [auto1.de] INFO: Scrape type for SB93381: 0
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: DZ93039
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: XT91085
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: AG38936
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: CJ15757
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: VW18097
2026-03-29 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW18097%27 HTTP/1.1" 200 None
2026-03-29 10:41:44 [auto1.de] INFO: Scrape type for VW18097: 0
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: ZE67546
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: DS04882
2026-03-29 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS04882%27 HTTP/1.1" 200 None
2026-03-29 10:41:44 [auto1.de] INFO: Scrape type for DS04882: 0
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: DF58718
2026-03-29 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF58718%27 HTTP/1.1" 200 None
2026-03-29 10:41:44 [auto1.de] INFO: Scrape type for DF58718: 0
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: GC08315
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: ND71699
2026-03-29 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND71699%27 HTTP/1.1" 200 None
2026-03-29 10:41:44 [auto1.de] INFO: Scrape type for ND71699: 0
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: PT06802
2026-03-29 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT06802%27 HTTP/1.1" 200 None
2026-03-29 10:41:44 [auto1.de] INFO: Scrape type for PT06802: 0
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: MJ66272
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: XC89129
2026-03-29 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC89129%27 HTTP/1.1" 200 None
2026-03-29 10:41:44 [auto1.de] INFO: Scrape type for XC89129: 0
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: DV32986
2026-03-29 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV32986%27 HTTP/1.1" 200 None
2026-03-29 10:41:44 [auto1.de] INFO: Scrape type for DV32986: 0
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: DN96798
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: YR51740
2026-03-29 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR51740%27 HTTP/1.1" 200 None
2026-03-29 10:41:44 [auto1.de] INFO: Scrape type for YR51740: 0
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: HK34206
2026-03-29 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK34206%27 HTTP/1.1" 200 None
2026-03-29 10:41:44 [auto1.de] INFO: Scrape type for HK34206: 0
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: ZX08266
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: DA14400
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: XF58855
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: WA63684
2026-03-29 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA63684%27 HTTP/1.1" 200 None
2026-03-29 10:41:44 [auto1.de] INFO: Scrape type for WA63684: 0
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: BW69940
2026-03-29 10:41:44 [auto1.de] INFO: Found listing with ID: DK33698
2026-03-29 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK33698%27 HTTP/1.1" 200 None
2026-03-29 10:41:44 [auto1.de] INFO: Scrape type for DK33698: 0
2026-03-29 10:41:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:41:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:41:48 [auto1.de] INFO: Channel: 24h | Page: 95 | totalHits: 6726 | hits on page: 40
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: PN31203
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: BX53792
2026-03-29 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX53792%27 HTTP/1.1" 200 None
2026-03-29 10:41:48 [auto1.de] INFO: Scrape type for BX53792: 0
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: AR87592
2026-03-29 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR87592%27 HTTP/1.1" 200 None
2026-03-29 10:41:48 [auto1.de] INFO: Scrape type for AR87592: 0
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: RS40485
2026-03-29 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS40485%27 HTTP/1.1" 200 None
2026-03-29 10:41:48 [auto1.de] INFO: Scrape type for RS40485: 0
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: FS76993
2026-03-29 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS76993%27 HTTP/1.1" 200 None
2026-03-29 10:41:48 [auto1.de] INFO: Scrape type for FS76993: 0
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: YW88691
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: JT26189
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: GL29302
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: FS96919
2026-03-29 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS96919%27 HTTP/1.1" 200 None
2026-03-29 10:41:48 [auto1.de] INFO: Scrape type for FS96919: 0
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: BF85943
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: MK56575
2026-03-29 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK56575%27 HTTP/1.1" 200 None
2026-03-29 10:41:48 [auto1.de] INFO: Scrape type for MK56575: 0
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: YH44518
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: LM46602
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: HA16942
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: EE67524
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: SD35692
2026-03-29 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD35692%27 HTTP/1.1" 200 None
2026-03-29 10:41:48 [auto1.de] INFO: Scrape type for SD35692: 0
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: VY57936
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: AJ85569
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: EA77246
2026-03-29 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA77246%27 HTTP/1.1" 200 None
2026-03-29 10:41:48 [auto1.de] INFO: Scrape type for EA77246: 0
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: VH78642
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: FL30108
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: XV26734
2026-03-29 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV26734%27 HTTP/1.1" 200 None
2026-03-29 10:41:48 [auto1.de] INFO: Scrape type for XV26734: 0
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: UM69189
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: NG74955
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: GL61675
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: NG69344
2026-03-29 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG69344%27 HTTP/1.1" 200 None
2026-03-29 10:41:48 [auto1.de] INFO: Scrape type for NG69344: 0
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: ZW88785
2026-03-29 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW88785%27 HTTP/1.1" 200 None
2026-03-29 10:41:48 [auto1.de] INFO: Scrape type for ZW88785: 0
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: CW59742
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: BW06132
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: TC26510
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: TV11727
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: FP32439
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: KY67779
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: WJ94391
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: KM78395
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: GR86063
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: EP74565
2026-03-29 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP74565%27 HTTP/1.1" 200 None
2026-03-29 10:41:48 [auto1.de] INFO: Scrape type for EP74565: 0
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: LW85167
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: LN38152
2026-03-29 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN38152%27 HTTP/1.1" 200 None
2026-03-29 10:41:48 [auto1.de] INFO: Scrape type for LN38152: 0
2026-03-29 10:41:48 [auto1.de] INFO: Found listing with ID: UH78050
2026-03-29 10:41:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:41:52 [auto1.de] INFO: Channel: 24h | Page: 96 | totalHits: 6726 | hits on page: 40
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: DN13458
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN13458%27 HTTP/1.1" 200 None
2026-03-29 10:41:52 [auto1.de] INFO: Scrape type for DN13458: 0
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: JL85877
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: UG80172
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG80172%27 HTTP/1.1" 200 None
2026-03-29 10:41:52 [auto1.de] INFO: Scrape type for UG80172: 0
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: AC95378
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC95378%27 HTTP/1.1" 200 None
2026-03-29 10:41:52 [auto1.de] INFO: Scrape type for AC95378: 0
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: CW13893
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: YS72291
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS72291%27 HTTP/1.1" 200 None
2026-03-29 10:41:52 [auto1.de] INFO: Scrape type for YS72291: 0
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: DR31322
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: TJ09014
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: TA25367
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: ML19559
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: AL26903
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: HL58412
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: AD35771
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: EJ83325
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ83325%27 HTTP/1.1" 200 None
2026-03-29 10:41:52 [auto1.de] INFO: Scrape type for EJ83325: 0
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: KU21621
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: SR77795
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: PN78353
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: TF52264
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: HR97485
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR97485%27 HTTP/1.1" 200 None
2026-03-29 10:41:52 [auto1.de] INFO: Scrape type for HR97485: 0
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: HY91019
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY91019%27 HTTP/1.1" 200 None
2026-03-29 10:41:52 [auto1.de] INFO: Scrape type for HY91019: 0
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: PD62787
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD62787%27 HTTP/1.1" 200 None
2026-03-29 10:41:52 [auto1.de] INFO: Scrape type for PD62787: 0
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: EL68687
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL68687%27 HTTP/1.1" 200 None
2026-03-29 10:41:52 [auto1.de] INFO: Scrape type for EL68687: 0
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: PW70056
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: ZY28796
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY28796%27 HTTP/1.1" 200 None
2026-03-29 10:41:52 [auto1.de] INFO: Scrape type for ZY28796: 0
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: RB37125
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB37125%27 HTTP/1.1" 200 None
2026-03-29 10:41:52 [auto1.de] INFO: Scrape type for RB37125: 0
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: MG33600
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG33600%27 HTTP/1.1" 200 None
2026-03-29 10:41:52 [auto1.de] INFO: Scrape type for MG33600: 0
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: SM91292
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: UA59851
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA59851%27 HTTP/1.1" 200 None
2026-03-29 10:41:52 [auto1.de] INFO: Scrape type for UA59851: 0
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: GN24423
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN24423%27 HTTP/1.1" 200 None
2026-03-29 10:41:52 [auto1.de] INFO: Scrape type for GN24423: 0
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: FZ71323
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: AH37368
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: SB28206
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB28206%27 HTTP/1.1" 200 None
2026-03-29 10:41:52 [auto1.de] INFO: Scrape type for SB28206: 0
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: AN78451
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN78451%27 HTTP/1.1" 200 None
2026-03-29 10:41:52 [auto1.de] INFO: Scrape type for AN78451: 0
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: EF84485
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: TT68659
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: EG87318
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: MD27320
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD27320%27 HTTP/1.1" 200 None
2026-03-29 10:41:52 [auto1.de] INFO: Scrape type for MD27320: 0
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: UW23884
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW23884%27 HTTP/1.1" 200 None
2026-03-29 10:41:52 [auto1.de] INFO: Scrape type for UW23884: 0
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: HF48601
2026-03-29 10:41:52 [auto1.de] INFO: Found listing with ID: WC45623
2026-03-29 10:41:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:42:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:42:00 [auto1.de] INFO: Channel: 24h | Page: 97 | totalHits: 6726 | hits on page: 40
2026-03-29 10:42:00 [auto1.de] INFO: Found listing with ID: EG77695
2026-03-29 10:42:00 [auto1.de] INFO: Found listing with ID: EX93586
2026-03-29 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX93586%27 HTTP/1.1" 200 None
2026-03-29 10:42:00 [auto1.de] INFO: Scrape type for EX93586: 0
2026-03-29 10:42:00 [auto1.de] INFO: Found listing with ID: CA65942
2026-03-29 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA65942%27 HTTP/1.1" 200 None
2026-03-29 10:42:00 [auto1.de] INFO: Scrape type for CA65942: 0
2026-03-29 10:42:00 [auto1.de] INFO: Found listing with ID: NV85283
2026-03-29 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV85283%27 HTTP/1.1" 200 None
2026-03-29 10:42:00 [auto1.de] INFO: Scrape type for NV85283: 0
2026-03-29 10:42:00 [auto1.de] INFO: Found listing with ID: UY74953
2026-03-29 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY74953%27 HTTP/1.1" 200 None
2026-03-29 10:42:00 [auto1.de] INFO: Scrape type for UY74953: 0
2026-03-29 10:42:00 [auto1.de] INFO: Found listing with ID: KP12697
2026-03-29 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP12697%27 HTTP/1.1" 200 None
2026-03-29 10:42:00 [auto1.de] INFO: Scrape type for KP12697: 0
2026-03-29 10:42:00 [auto1.de] INFO: Found listing with ID: UB26055
2026-03-29 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB26055%27 HTTP/1.1" 200 None
2026-03-29 10:42:00 [auto1.de] INFO: Scrape type for UB26055: 0
2026-03-29 10:42:00 [auto1.de] INFO: Found listing with ID: VL71663
2026-03-29 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL71663%27 HTTP/1.1" 200 None
2026-03-29 10:42:00 [auto1.de] INFO: Scrape type for VL71663: 0
2026-03-29 10:42:00 [auto1.de] INFO: Found listing with ID: JP54532
2026-03-29 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP54532%27 HTTP/1.1" 200 None
2026-03-29 10:42:00 [auto1.de] INFO: Scrape type for JP54532: 0
2026-03-29 10:42:00 [auto1.de] INFO: Found listing with ID: BA73417
2026-03-29 10:42:00 [auto1.de] INFO: Found listing with ID: VH26233
2026-03-29 10:42:00 [auto1.de] INFO: Found listing with ID: DW23670
2026-03-29 10:42:00 [auto1.de] INFO: Found listing with ID: NU40384
2026-03-29 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU40384%27 HTTP/1.1" 200 None
2026-03-29 10:42:00 [auto1.de] INFO: Scrape type for NU40384: 0
2026-03-29 10:42:00 [auto1.de] INFO: Found listing with ID: GU60494
2026-03-29 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU60494%27 HTTP/1.1" 200 None
2026-03-29 10:42:00 [auto1.de] INFO: Scrape type for GU60494: 0
2026-03-29 10:42:00 [auto1.de] INFO: Found listing with ID: DJ93554
2026-03-29 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ93554%27 HTTP/1.1" 200 None
2026-03-29 10:42:00 [auto1.de] INFO: Scrape type for DJ93554: 0
2026-03-29 10:42:00 [auto1.de] INFO: Found listing with ID: XN26192
2026-03-29 10:42:00 [auto1.de] INFO: Found listing with ID: WA19353
2026-03-29 10:42:00 [auto1.de] INFO: Found listing with ID: UY13477
2026-03-29 10:42:00 [auto1.de] INFO: Found listing with ID: MX70218
2026-03-29 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX70218%27 HTTP/1.1" 200 None
2026-03-29 10:42:01 [auto1.de] INFO: Scrape type for MX70218: 0
2026-03-29 10:42:01 [auto1.de] INFO: Found listing with ID: GM59511
2026-03-29 10:42:01 [auto1.de] INFO: Found listing with ID: RR46383
2026-03-29 10:42:01 [auto1.de] INFO: Found listing with ID: ZL15649
2026-03-29 10:42:01 [auto1.de] INFO: Found listing with ID: EP31898
2026-03-29 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP31898%27 HTTP/1.1" 200 None
2026-03-29 10:42:01 [auto1.de] INFO: Scrape type for EP31898: 0
2026-03-29 10:42:01 [auto1.de] INFO: Found listing with ID: BL86865
2026-03-29 10:42:01 [auto1.de] INFO: Found listing with ID: EE83336
2026-03-29 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE83336%27 HTTP/1.1" 200 None
2026-03-29 10:42:01 [auto1.de] INFO: Scrape type for EE83336: 0
2026-03-29 10:42:01 [auto1.de] INFO: Found listing with ID: TR74961
2026-03-29 10:42:01 [auto1.de] INFO: Found listing with ID: GE21325
2026-03-29 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE21325%27 HTTP/1.1" 200 None
2026-03-29 10:42:01 [auto1.de] INFO: Scrape type for GE21325: 0
2026-03-29 10:42:01 [auto1.de] INFO: Found listing with ID: SR51449
2026-03-29 10:42:01 [auto1.de] INFO: Found listing with ID: XS82974
2026-03-29 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS82974%27 HTTP/1.1" 200 None
2026-03-29 10:42:01 [auto1.de] INFO: Scrape type for XS82974: 0
2026-03-29 10:42:01 [auto1.de] INFO: Found listing with ID: EN73396
2026-03-29 10:42:01 [auto1.de] INFO: Found listing with ID: MJ31328
2026-03-29 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ31328%27 HTTP/1.1" 200 None
2026-03-29 10:42:01 [auto1.de] INFO: Scrape type for MJ31328: 0
2026-03-29 10:42:01 [auto1.de] INFO: Found listing with ID: CB52035
2026-03-29 10:42:01 [auto1.de] INFO: Found listing with ID: XD56030
2026-03-29 10:42:01 [auto1.de] INFO: Found listing with ID: AE81199
2026-03-29 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE81199%27 HTTP/1.1" 200 None
2026-03-29 10:42:01 [auto1.de] INFO: Scrape type for AE81199: 0
2026-03-29 10:42:01 [auto1.de] INFO: Found listing with ID: BR53906
2026-03-29 10:42:01 [auto1.de] INFO: Found listing with ID: CC89680
2026-03-29 10:42:01 [auto1.de] INFO: Found listing with ID: DT53290
2026-03-29 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT53290%27 HTTP/1.1" 200 None
2026-03-29 10:42:01 [auto1.de] INFO: Scrape type for DT53290: 0
2026-03-29 10:42:01 [auto1.de] INFO: Found listing with ID: XV53612
2026-03-29 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV53612%27 HTTP/1.1" 200 None
2026-03-29 10:42:01 [auto1.de] INFO: Scrape type for XV53612: 0
2026-03-29 10:42:01 [auto1.de] INFO: Found listing with ID: UP12343
2026-03-29 10:42:01 [auto1.de] INFO: Found listing with ID: FJ72456
2026-03-29 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ72456%27 HTTP/1.1" 200 None
2026-03-29 10:42:01 [auto1.de] INFO: Scrape type for FJ72456: 0
2026-03-29 10:42:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:42:06 [scrapy.extensions.logstats] INFO: Crawled 159 pages (at 9 pages/min), scraped 245 items (at 3 items/min)
2026-03-29 10:42:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 160MiB
2026-03-29 10:42:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:42:12 [auto1.de] INFO: Channel: 24h | Page: 98 | totalHits: 6726 | hits on page: 40
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: ZP66388
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP66388%27 HTTP/1.1" 200 None
2026-03-29 10:42:12 [auto1.de] INFO: Scrape type for ZP66388: 0
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: HJ28276
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ28276%27 HTTP/1.1" 200 None
2026-03-29 10:42:12 [auto1.de] INFO: Scrape type for HJ28276: 0
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: YJ21750
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ21750%27 HTTP/1.1" 200 None
2026-03-29 10:42:12 [auto1.de] INFO: Scrape type for YJ21750: 0
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: YH44643
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH44643%27 HTTP/1.1" 200 None
2026-03-29 10:42:12 [auto1.de] INFO: Scrape type for YH44643: 0
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: YF42870
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: JJ72083
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ72083%27 HTTP/1.1" 200 None
2026-03-29 10:42:12 [auto1.de] INFO: Scrape type for JJ72083: 0
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: PT78073
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT78073%27 HTTP/1.1" 200 None
2026-03-29 10:42:12 [auto1.de] INFO: Scrape type for PT78073: 0
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: MX02891
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: FJ98191
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: JP08522
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP08522%27 HTTP/1.1" 200 None
2026-03-29 10:42:12 [auto1.de] INFO: Scrape type for JP08522: 0
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: JN55022
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: SG10067
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: CN91045
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN91045%27 HTTP/1.1" 200 None
2026-03-29 10:42:12 [auto1.de] INFO: Scrape type for CN91045: 0
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: KB55712
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: EM77424
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: YC44419
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC44419%27 HTTP/1.1" 200 None
2026-03-29 10:42:12 [auto1.de] INFO: Scrape type for YC44419: 0
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: CX18884
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX18884%27 HTTP/1.1" 200 None
2026-03-29 10:42:12 [auto1.de] INFO: Scrape type for CX18884: 0
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: MM29891
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM29891%27 HTTP/1.1" 200 None
2026-03-29 10:42:12 [auto1.de] INFO: Scrape type for MM29891: 0
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: WZ42381
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ42381%27 HTTP/1.1" 200 None
2026-03-29 10:42:12 [auto1.de] INFO: Scrape type for WZ42381: 0
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: DG24182
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: CV73879
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: VJ82092
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ82092%27 HTTP/1.1" 200 None
2026-03-29 10:42:12 [auto1.de] INFO: Scrape type for VJ82092: 0
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: CH69099
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: WL17910
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: MC57954
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC57954%27 HTTP/1.1" 200 None
2026-03-29 10:42:12 [auto1.de] INFO: Scrape type for MC57954: 0
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: CD36219
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD36219%27 HTTP/1.1" 200 None
2026-03-29 10:42:12 [auto1.de] INFO: Scrape type for CD36219: 0
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: PM25348
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: HS03842
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: BS26605
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: VV03695
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV03695%27 HTTP/1.1" 200 None
2026-03-29 10:42:12 [auto1.de] INFO: Scrape type for VV03695: 0
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: JS09258
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: MV92494
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV92494%27 HTTP/1.1" 200 None
2026-03-29 10:42:12 [auto1.de] INFO: Scrape type for MV92494: 0
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: GD60404
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: TJ67594
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: AE71125
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE71125%27 HTTP/1.1" 200 None
2026-03-29 10:42:12 [auto1.de] INFO: Scrape type for AE71125: 0
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: TL45864
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: RP65815
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP65815%27 HTTP/1.1" 200 None
2026-03-29 10:42:12 [auto1.de] INFO: Scrape type for RP65815: 0
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: CF09149
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: VT43931
2026-03-29 10:42:12 [auto1.de] INFO: Found listing with ID: TS05974
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS05974%27 HTTP/1.1" 200 None
2026-03-29 10:42:12 [auto1.de] INFO: Scrape type for TS05974: 0
2026-03-29 10:42:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:42:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:42:14 [auto1.de] INFO: Channel: 24h | Page: 99 | totalHits: 6726 | hits on page: 40
2026-03-29 10:42:14 [auto1.de] INFO: Found listing with ID: MJ41620
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ41620%27 HTTP/1.1" 200 None
2026-03-29 10:42:14 [auto1.de] INFO: Scrape type for MJ41620: 0
2026-03-29 10:42:14 [auto1.de] INFO: Found listing with ID: GV28684
2026-03-29 10:42:14 [auto1.de] INFO: Found listing with ID: HV65540
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV65540%27 HTTP/1.1" 200 None
2026-03-29 10:42:14 [auto1.de] INFO: Scrape type for HV65540: 0
2026-03-29 10:42:14 [auto1.de] INFO: Found listing with ID: NH86896
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH86896%27 HTTP/1.1" 200 None
2026-03-29 10:42:14 [auto1.de] INFO: Scrape type for NH86896: 0
2026-03-29 10:42:14 [auto1.de] INFO: Found listing with ID: MU47356
2026-03-29 10:42:14 [auto1.de] INFO: Found listing with ID: CU80256
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU80256%27 HTTP/1.1" 200 None
2026-03-29 10:42:14 [auto1.de] INFO: Scrape type for CU80256: 0
2026-03-29 10:42:14 [auto1.de] INFO: Found listing with ID: YS13064
2026-03-29 10:42:14 [auto1.de] INFO: Found listing with ID: ME33936
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME33936%27 HTTP/1.1" 200 None
2026-03-29 10:42:14 [auto1.de] INFO: Scrape type for ME33936: 0
2026-03-29 10:42:14 [auto1.de] INFO: Found listing with ID: DG19497
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG19497%27 HTTP/1.1" 200 None
2026-03-29 10:42:14 [auto1.de] INFO: Scrape type for DG19497: 0
2026-03-29 10:42:14 [auto1.de] INFO: Found listing with ID: WV38848
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV38848%27 HTTP/1.1" 200 None
2026-03-29 10:42:14 [auto1.de] INFO: Scrape type for WV38848: 0
2026-03-29 10:42:14 [auto1.de] INFO: Found listing with ID: CB80286
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB80286%27 HTTP/1.1" 200 None
2026-03-29 10:42:14 [auto1.de] INFO: Scrape type for CB80286: 0
2026-03-29 10:42:14 [auto1.de] INFO: Found listing with ID: RH59786
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH59786%27 HTTP/1.1" 200 None
2026-03-29 10:42:14 [auto1.de] INFO: Scrape type for RH59786: 0
2026-03-29 10:42:14 [auto1.de] INFO: Found listing with ID: VJ59637
2026-03-29 10:42:14 [auto1.de] INFO: Found listing with ID: UU53643
2026-03-29 10:42:14 [auto1.de] INFO: Found listing with ID: LG97713
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG97713%27 HTTP/1.1" 200 None
2026-03-29 10:42:14 [auto1.de] INFO: Scrape type for LG97713: 0
2026-03-29 10:42:14 [auto1.de] INFO: Found listing with ID: RX21744
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX21744%27 HTTP/1.1" 200 None
2026-03-29 10:42:14 [auto1.de] INFO: Scrape type for RX21744: 0
2026-03-29 10:42:14 [auto1.de] INFO: Found listing with ID: HN24396
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN24396%27 HTTP/1.1" 200 None
2026-03-29 10:42:14 [auto1.de] INFO: Scrape type for HN24396: 0
2026-03-29 10:42:14 [auto1.de] INFO: Found listing with ID: PS84197
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS84197%27 HTTP/1.1" 200 None
2026-03-29 10:42:14 [auto1.de] INFO: Scrape type for PS84197: 0
2026-03-29 10:42:14 [auto1.de] INFO: Found listing with ID: VL16221
2026-03-29 10:42:14 [auto1.de] INFO: Found listing with ID: KD49468
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD49468%27 HTTP/1.1" 200 None
2026-03-29 10:42:14 [auto1.de] INFO: Scrape type for KD49468: 0
2026-03-29 10:42:14 [auto1.de] INFO: Found listing with ID: SZ56060
2026-03-29 10:42:14 [auto1.de] INFO: Found listing with ID: MF02392
2026-03-29 10:42:14 [auto1.de] INFO: Found listing with ID: UD17279
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD17279%27 HTTP/1.1" 200 None
2026-03-29 10:42:14 [auto1.de] INFO: Scrape type for UD17279: 0
2026-03-29 10:42:14 [auto1.de] INFO: Found listing with ID: MV56275
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV56275%27 HTTP/1.1" 200 None
2026-03-29 10:42:14 [auto1.de] INFO: Scrape type for MV56275: 0
2026-03-29 10:42:14 [auto1.de] INFO: Found listing with ID: AH95980
2026-03-29 10:42:14 [auto1.de] INFO: Found listing with ID: AG53647
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG53647%27 HTTP/1.1" 200 None
2026-03-29 10:42:14 [auto1.de] INFO: Scrape type for AG53647: 0
2026-03-29 10:42:14 [auto1.de] INFO: Found listing with ID: NX28269
2026-03-29 10:42:14 [auto1.de] INFO: Found listing with ID: MR73613
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR73613%27 HTTP/1.1" 200 None
2026-03-29 10:42:14 [auto1.de] INFO: Scrape type for MR73613: 0
2026-03-29 10:42:14 [auto1.de] INFO: Found listing with ID: TE18178
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE18178%27 HTTP/1.1" 200 None
2026-03-29 10:42:14 [auto1.de] INFO: Scrape type for TE18178: 0
2026-03-29 10:42:14 [auto1.de] INFO: Found listing with ID: UR77332
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR77332%27 HTTP/1.1" 200 None
2026-03-29 10:42:14 [auto1.de] INFO: Scrape type for UR77332: 2
2026-03-29 10:42:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abbab86b-5980-5ed7-8c91-7c14255e0f1a with identifier: UR77332
2026-03-29 10:42:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abbab86b-5980-5ed7-8c91-7c14255e0f1a with scrape type 2
2026-03-29 10:42:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abbab86b-5980-5ed7-8c91-7c14255e0f1a with scrape type 2
2026-03-29 10:42:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abbab86b-5980-5ed7-8c91-7c14255e0f1a, identifier: UR77332
2026-03-29 10:42:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abbab86b-5980-5ed7-8c91-7c14255e0f1a with identifier: UR77332
2026-03-29 10:42:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abbab86b-5980-5ed7-8c91-7c14255e0f1a with identifier: UR77332
2026-03-29 10:42:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abbab86b-5980-5ed7-8c91-7c14255e0f1a with identifier: UR77332 to the API
2026-03-29 10:42:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:42:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:42:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-30T15:03:06Z',
 'fuel_type': 'petrol',
 'id': 'abbab86b-5980-5ed7-8c91-7c14255e0f1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR77332',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 48407,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-10',
 'seller_name': None,
 'title': 'BMW 3er 330i xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2017}
2026-03-29 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR77332%27 HTTP/1.1" 200 None
2026-03-29 10:42:15 [auto1.de] INFO: Saving data for UR77332: {'auction_closing_time': 1774882986.0, 'created_time': 1773342034.199119, 'last_price_update_time': 1774780935.764801}
2026-03-29 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UR77332') HTTP/1.1" 204 0
2026-03-29 10:42:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:42:15 [auto1.de] INFO: Found listing with ID: PC60688
2026-03-29 10:42:15 [auto1.de] INFO: Found listing with ID: DH44526
2026-03-29 10:42:15 [auto1.de] INFO: Found listing with ID: YD00860
2026-03-29 10:42:15 [auto1.de] INFO: Found listing with ID: GZ76571
2026-03-29 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ76571%27 HTTP/1.1" 200 None
2026-03-29 10:42:15 [auto1.de] INFO: Scrape type for GZ76571: 0
2026-03-29 10:42:15 [auto1.de] INFO: Found listing with ID: TA92521
2026-03-29 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA92521%27 HTTP/1.1" 200 None
2026-03-29 10:42:15 [auto1.de] INFO: Scrape type for TA92521: 0
2026-03-29 10:42:15 [auto1.de] INFO: Found listing with ID: JM70147
2026-03-29 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM70147%27 HTTP/1.1" 200 None
2026-03-29 10:42:15 [auto1.de] INFO: Scrape type for JM70147: 0
2026-03-29 10:42:15 [auto1.de] INFO: Found listing with ID: LA13205
2026-03-29 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA13205%27 HTTP/1.1" 200 None
2026-03-29 10:42:15 [auto1.de] INFO: Scrape type for LA13205: 0
2026-03-29 10:42:15 [auto1.de] INFO: Found listing with ID: XM62598
2026-03-29 10:42:15 [auto1.de] INFO: Found listing with ID: NS16825
2026-03-29 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS16825%27 HTTP/1.1" 200 None
2026-03-29 10:42:15 [auto1.de] INFO: Scrape type for NS16825: 0
2026-03-29 10:42:15 [auto1.de] INFO: Found listing with ID: RN25126
2026-03-29 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN25126%27 HTTP/1.1" 200 None
2026-03-29 10:42:15 [auto1.de] INFO: Scrape type for RN25126: 0
2026-03-29 10:42:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:42:17 [auto1.de] INFO: Channel: 24h | Page: 100 | totalHits: 6726 | hits on page: 40
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: HD52891
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD52891%27 HTTP/1.1" 200 None
2026-03-29 10:42:17 [auto1.de] INFO: Scrape type for HD52891: 0
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: TA95211
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA95211%27 HTTP/1.1" 200 None
2026-03-29 10:42:17 [auto1.de] INFO: Scrape type for TA95211: 0
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: MG28857
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: JK60563
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK60563%27 HTTP/1.1" 200 None
2026-03-29 10:42:17 [auto1.de] INFO: Scrape type for JK60563: 0
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: KJ44451
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ44451%27 HTTP/1.1" 200 None
2026-03-29 10:42:17 [auto1.de] INFO: Scrape type for KJ44451: 0
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: UN86111
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN86111%27 HTTP/1.1" 200 None
2026-03-29 10:42:17 [auto1.de] INFO: Scrape type for UN86111: 0
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: CP73203
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP73203%27 HTTP/1.1" 200 None
2026-03-29 10:42:17 [auto1.de] INFO: Scrape type for CP73203: 0
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: LR06917
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: GP13767
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP13767%27 HTTP/1.1" 200 None
2026-03-29 10:42:17 [auto1.de] INFO: Scrape type for GP13767: 0
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: YZ29676
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ29676%27 HTTP/1.1" 200 None
2026-03-29 10:42:17 [auto1.de] INFO: Scrape type for YZ29676: 0
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: FZ80305
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ80305%27 HTTP/1.1" 200 None
2026-03-29 10:42:17 [auto1.de] INFO: Scrape type for FZ80305: 0
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: UE57150
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: HJ77178
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ77178%27 HTTP/1.1" 200 None
2026-03-29 10:42:17 [auto1.de] INFO: Scrape type for HJ77178: 0
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: SX22441
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX22441%27 HTTP/1.1" 200 None
2026-03-29 10:42:17 [auto1.de] INFO: Scrape type for SX22441: 0
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: VL79730
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: JX01740
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: RU51432
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU51432%27 HTTP/1.1" 200 None
2026-03-29 10:42:17 [auto1.de] INFO: Scrape type for RU51432: 0
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: CY50821
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: XR36805
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR36805%27 HTTP/1.1" 200 None
2026-03-29 10:42:17 [auto1.de] INFO: Scrape type for XR36805: 0
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: FH83727
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH83727%27 HTTP/1.1" 200 None
2026-03-29 10:42:17 [auto1.de] INFO: Scrape type for FH83727: 0
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: BB82459
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB82459%27 HTTP/1.1" 200 None
2026-03-29 10:42:17 [auto1.de] INFO: Scrape type for BB82459: 0
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: MV29238
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV29238%27 HTTP/1.1" 200 None
2026-03-29 10:42:17 [auto1.de] INFO: Scrape type for MV29238: 0
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: AP93832
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP93832%27 HTTP/1.1" 200 None
2026-03-29 10:42:17 [auto1.de] INFO: Scrape type for AP93832: 0
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: BD98070
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: NA20314
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA20314%27 HTTP/1.1" 200 None
2026-03-29 10:42:17 [auto1.de] INFO: Scrape type for NA20314: 0
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: CG78657
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG78657%27 HTTP/1.1" 200 None
2026-03-29 10:42:17 [auto1.de] INFO: Scrape type for CG78657: 0
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: VC16092
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC16092%27 HTTP/1.1" 200 None
2026-03-29 10:42:17 [auto1.de] INFO: Scrape type for VC16092: 0
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: PH00076
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: LF39104
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF39104%27 HTTP/1.1" 200 None
2026-03-29 10:42:17 [auto1.de] INFO: Scrape type for LF39104: 0
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: RD80564
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD80564%27 HTTP/1.1" 200 None
2026-03-29 10:42:17 [auto1.de] INFO: Scrape type for RD80564: 0
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: AD50420
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: TR76591
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR76591%27 HTTP/1.1" 200 None
2026-03-29 10:42:17 [auto1.de] INFO: Scrape type for TR76591: 0
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: EE47451
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE47451%27 HTTP/1.1" 200 None
2026-03-29 10:42:17 [auto1.de] INFO: Scrape type for EE47451: 0
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: XY17081
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY17081%27 HTTP/1.1" 200 None
2026-03-29 10:42:17 [auto1.de] INFO: Scrape type for XY17081: 0
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: YP68247
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP68247%27 HTTP/1.1" 200 None
2026-03-29 10:42:17 [auto1.de] INFO: Scrape type for YP68247: 0
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: BE83152
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE83152%27 HTTP/1.1" 200 None
2026-03-29 10:42:17 [auto1.de] INFO: Scrape type for BE83152: 0
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: UH10138
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: JM75105
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM75105%27 HTTP/1.1" 200 None
2026-03-29 10:42:17 [auto1.de] INFO: Scrape type for JM75105: 0
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: ZB26924
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB26924%27 HTTP/1.1" 200 None
2026-03-29 10:42:17 [auto1.de] INFO: Scrape type for ZB26924: 0
2026-03-29 10:42:17 [auto1.de] INFO: Found listing with ID: GD70369
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD70369%27 HTTP/1.1" 200 None
2026-03-29 10:42:17 [auto1.de] INFO: Scrape type for GD70369: 0
2026-03-29 10:42:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:42:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:42:18 [auto1.de] INFO: Channel: 24h | Page: 101 | totalHits: 6726 | hits on page: 40
2026-03-29 10:42:18 [auto1.de] INFO: Found listing with ID: LN93862
2026-03-29 10:42:18 [auto1.de] INFO: Found listing with ID: ZF91540
2026-03-29 10:42:18 [auto1.de] INFO: Found listing with ID: SZ38457
2026-03-29 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ38457%27 HTTP/1.1" 200 None
2026-03-29 10:42:18 [auto1.de] INFO: Scrape type for SZ38457: 0
2026-03-29 10:42:18 [auto1.de] INFO: Found listing with ID: DE85774
2026-03-29 10:42:18 [auto1.de] INFO: Found listing with ID: ET59047
2026-03-29 10:42:18 [auto1.de] INFO: Found listing with ID: DG70282
2026-03-29 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG70282%27 HTTP/1.1" 200 None
2026-03-29 10:42:18 [auto1.de] INFO: Scrape type for DG70282: 0
2026-03-29 10:42:18 [auto1.de] INFO: Found listing with ID: VW39086
2026-03-29 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW39086%27 HTTP/1.1" 200 None
2026-03-29 10:42:18 [auto1.de] INFO: Scrape type for VW39086: 0
2026-03-29 10:42:18 [auto1.de] INFO: Found listing with ID: BR76788
2026-03-29 10:42:18 [auto1.de] INFO: Found listing with ID: XV50981
2026-03-29 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV50981%27 HTTP/1.1" 200 None
2026-03-29 10:42:18 [auto1.de] INFO: Scrape type for XV50981: 0
2026-03-29 10:42:18 [auto1.de] INFO: Found listing with ID: ZL76152
2026-03-29 10:42:18 [auto1.de] INFO: Found listing with ID: KN98252
2026-03-29 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN98252%27 HTTP/1.1" 200 None
2026-03-29 10:42:18 [auto1.de] INFO: Scrape type for KN98252: 0
2026-03-29 10:42:18 [auto1.de] INFO: Found listing with ID: PA85998
2026-03-29 10:42:18 [auto1.de] INFO: Found listing with ID: XC54847
2026-03-29 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC54847%27 HTTP/1.1" 200 None
2026-03-29 10:42:18 [auto1.de] INFO: Scrape type for XC54847: 0
2026-03-29 10:42:18 [auto1.de] INFO: Found listing with ID: SV32169
2026-03-29 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV32169%27 HTTP/1.1" 200 None
2026-03-29 10:42:18 [auto1.de] INFO: Scrape type for SV32169: 0
2026-03-29 10:42:18 [auto1.de] INFO: Found listing with ID: SE32009
2026-03-29 10:42:18 [auto1.de] INFO: Found listing with ID: VT76935
2026-03-29 10:42:18 [auto1.de] INFO: Found listing with ID: AP07103
2026-03-29 10:42:18 [auto1.de] INFO: Found listing with ID: BE16908
2026-03-29 10:42:18 [auto1.de] INFO: Found listing with ID: JH64089
2026-03-29 10:42:18 [auto1.de] INFO: Found listing with ID: GY26864
2026-03-29 10:42:18 [auto1.de] INFO: Found listing with ID: MX47183
2026-03-29 10:42:18 [auto1.de] INFO: Found listing with ID: RE30080
2026-03-29 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE30080%27 HTTP/1.1" 200 None
2026-03-29 10:42:18 [auto1.de] INFO: Scrape type for RE30080: 0
2026-03-29 10:42:18 [auto1.de] INFO: Found listing with ID: ZM37202
2026-03-29 10:42:18 [auto1.de] INFO: Found listing with ID: RN43410
2026-03-29 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN43410%27 HTTP/1.1" 200 None
2026-03-29 10:42:18 [auto1.de] INFO: Scrape type for RN43410: 2
2026-03-29 10:42:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28523152-d07c-56ea-b88b-c7e3a0042f31 with identifier: RN43410
2026-03-29 10:42:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28523152-d07c-56ea-b88b-c7e3a0042f31 with scrape type 2
2026-03-29 10:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28523152-d07c-56ea-b88b-c7e3a0042f31 with scrape type 2
2026-03-29 10:42:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28523152-d07c-56ea-b88b-c7e3a0042f31, identifier: RN43410
2026-03-29 10:42:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28523152-d07c-56ea-b88b-c7e3a0042f31 with identifier: RN43410
2026-03-29 10:42:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28523152-d07c-56ea-b88b-c7e3a0042f31 with identifier: RN43410
2026-03-29 10:42:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28523152-d07c-56ea-b88b-c7e3a0042f31 with identifier: RN43410 to the API
2026-03-29 10:42:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:42:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:42:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:28:42Z',
 'fuel_type': 'diesel',
 'id': '28523152-d07c-56ea-b88b-c7e3a0042f31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN43410',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 236933,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-03',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-29 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN43410%27 HTTP/1.1" 200 None
2026-03-29 10:42:19 [auto1.de] INFO: Saving data for RN43410: {'auction_closing_time': 1774884522.0, 'created_time': 1774596971.362515, 'last_price_update_time': 1774780939.360652}
2026-03-29 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RN43410') HTTP/1.1" 204 0
2026-03-29 10:42:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:42:19 [auto1.de] INFO: Found listing with ID: DG85302
2026-03-29 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG85302%27 HTTP/1.1" 200 None
2026-03-29 10:42:19 [auto1.de] INFO: Scrape type for DG85302: 0
2026-03-29 10:42:19 [auto1.de] INFO: Found listing with ID: HT61440
2026-03-29 10:42:19 [auto1.de] INFO: Found listing with ID: VW61170
2026-03-29 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW61170%27 HTTP/1.1" 200 None
2026-03-29 10:42:19 [auto1.de] INFO: Scrape type for VW61170: 0
2026-03-29 10:42:19 [auto1.de] INFO: Found listing with ID: RX47602
2026-03-29 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX47602%27 HTTP/1.1" 200 None
2026-03-29 10:42:19 [auto1.de] INFO: Scrape type for RX47602: 0
2026-03-29 10:42:19 [auto1.de] INFO: Found listing with ID: PF23160
2026-03-29 10:42:19 [auto1.de] INFO: Found listing with ID: FZ98450
2026-03-29 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ98450%27 HTTP/1.1" 200 None
2026-03-29 10:42:19 [auto1.de] INFO: Scrape type for FZ98450: 0
2026-03-29 10:42:19 [auto1.de] INFO: Found listing with ID: TM90896
2026-03-29 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM90896%27 HTTP/1.1" 200 None
2026-03-29 10:42:19 [auto1.de] INFO: Scrape type for TM90896: 0
2026-03-29 10:42:19 [auto1.de] INFO: Found listing with ID: CS78773
2026-03-29 10:42:19 [auto1.de] INFO: Found listing with ID: XY25128
2026-03-29 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY25128%27 HTTP/1.1" 200 None
2026-03-29 10:42:19 [auto1.de] INFO: Scrape type for XY25128: 0
2026-03-29 10:42:19 [auto1.de] INFO: Found listing with ID: ZX93034
2026-03-29 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX93034%27 HTTP/1.1" 200 None
2026-03-29 10:42:19 [auto1.de] INFO: Scrape type for ZX93034: 0
2026-03-29 10:42:19 [auto1.de] INFO: Found listing with ID: XC20802
2026-03-29 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC20802%27 HTTP/1.1" 200 None
2026-03-29 10:42:19 [auto1.de] INFO: Scrape type for XC20802: 0
2026-03-29 10:42:19 [auto1.de] INFO: Found listing with ID: NY15812
2026-03-29 10:42:19 [auto1.de] INFO: Found listing with ID: UW48203
2026-03-29 10:42:19 [auto1.de] INFO: Found listing with ID: YC00325
2026-03-29 10:42:19 [auto1.de] INFO: Found listing with ID: EB92999
2026-03-29 10:42:19 [auto1.de] INFO: Found listing with ID: LZ76677
2026-03-29 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ76677%27 HTTP/1.1" 200 None
2026-03-29 10:42:19 [auto1.de] INFO: Scrape type for LZ76677: 0
2026-03-29 10:42:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:42:20 [auto1.de] INFO: Channel: 24h | Page: 102 | totalHits: 6726 | hits on page: 40
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: XF65798
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF65798%27 HTTP/1.1" 200 None
2026-03-29 10:42:20 [auto1.de] INFO: Scrape type for XF65798: 0
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: YJ27680
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: TE58420
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: EY23363
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: HV21869
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: TV91582
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV91582%27 HTTP/1.1" 200 None
2026-03-29 10:42:20 [auto1.de] INFO: Scrape type for TV91582: 0
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: PG63962
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: KL53261
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: WK06356
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: LU56386
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: LC77518
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: YS77012
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS77012%27 HTTP/1.1" 200 None
2026-03-29 10:42:20 [auto1.de] INFO: Scrape type for YS77012: 0
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: DU69800
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: AH07700
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: CX98688
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX98688%27 HTTP/1.1" 200 None
2026-03-29 10:42:20 [auto1.de] INFO: Scrape type for CX98688: 0
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: VB21266
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB21266%27 HTTP/1.1" 200 None
2026-03-29 10:42:20 [auto1.de] INFO: Scrape type for VB21266: 0
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: AU40553
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU40553%27 HTTP/1.1" 200 None
2026-03-29 10:42:20 [auto1.de] INFO: Scrape type for AU40553: 0
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: XP56939
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP56939%27 HTTP/1.1" 200 None
2026-03-29 10:42:20 [auto1.de] INFO: Scrape type for XP56939: 0
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: YG65181
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: BP72129
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP72129%27 HTTP/1.1" 200 None
2026-03-29 10:42:20 [auto1.de] INFO: Scrape type for BP72129: 0
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: JP48264
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP48264%27 HTTP/1.1" 200 None
2026-03-29 10:42:20 [auto1.de] INFO: Scrape type for JP48264: 0
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: AF84640
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: WY87564
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: BZ75769
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ75769%27 HTTP/1.1" 200 None
2026-03-29 10:42:20 [auto1.de] INFO: Scrape type for BZ75769: 0
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: BW18754
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: KG22409
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG22409%27 HTTP/1.1" 200 None
2026-03-29 10:42:20 [auto1.de] INFO: Scrape type for KG22409: 0
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: HV92794
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV92794%27 HTTP/1.1" 200 None
2026-03-29 10:42:20 [auto1.de] INFO: Scrape type for HV92794: 0
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: RM05292
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM05292%27 HTTP/1.1" 200 None
2026-03-29 10:42:20 [auto1.de] INFO: Scrape type for RM05292: 0
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: GJ83963
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ83963%27 HTTP/1.1" 200 None
2026-03-29 10:42:20 [auto1.de] INFO: Scrape type for GJ83963: 0
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: GZ21000
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: BP39163
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP39163%27 HTTP/1.1" 200 None
2026-03-29 10:42:20 [auto1.de] INFO: Scrape type for BP39163: 0
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: GP94559
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: YV66765
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV66765%27 HTTP/1.1" 200 None
2026-03-29 10:42:20 [auto1.de] INFO: Scrape type for YV66765: 0
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: RT17633
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT17633%27 HTTP/1.1" 200 None
2026-03-29 10:42:20 [auto1.de] INFO: Scrape type for RT17633: 0
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: YM28187
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: ZW99084
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW99084%27 HTTP/1.1" 200 None
2026-03-29 10:42:20 [auto1.de] INFO: Scrape type for ZW99084: 0
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: JH89792
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH89792%27 HTTP/1.1" 200 None
2026-03-29 10:42:20 [auto1.de] INFO: Scrape type for JH89792: 0
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: ZT23330
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT23330%27 HTTP/1.1" 200 None
2026-03-29 10:42:20 [auto1.de] INFO: Scrape type for ZT23330: 0
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: NY57954
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY57954%27 HTTP/1.1" 200 None
2026-03-29 10:42:20 [auto1.de] INFO: Scrape type for NY57954: 0
2026-03-29 10:42:20 [auto1.de] INFO: Found listing with ID: MZ83474
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ83474%27 HTTP/1.1" 200 None
2026-03-29 10:42:20 [auto1.de] INFO: Scrape type for MZ83474: 0
2026-03-29 10:42:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:42:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:42:23 [auto1.de] INFO: Channel: 24h | Page: 103 | totalHits: 6726 | hits on page: 40
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: VX14818
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: PA30689
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA30689%27 HTTP/1.1" 200 None
2026-03-29 10:42:23 [auto1.de] INFO: Scrape type for PA30689: 0
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: WP02035
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: ZE75344
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: BR02529
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR02529%27 HTTP/1.1" 200 None
2026-03-29 10:42:23 [auto1.de] INFO: Scrape type for BR02529: 0
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: AY81223
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: GA26329
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: FW15462
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: UA03321
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA03321%27 HTTP/1.1" 200 None
2026-03-29 10:42:23 [auto1.de] INFO: Scrape type for UA03321: 0
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: PG58570
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG58570%27 HTTP/1.1" 200 None
2026-03-29 10:42:23 [auto1.de] INFO: Scrape type for PG58570: 0
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: BR69139
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR69139%27 HTTP/1.1" 200 None
2026-03-29 10:42:23 [auto1.de] INFO: Scrape type for BR69139: 0
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: AH97983
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: CE50485
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE50485%27 HTTP/1.1" 200 None
2026-03-29 10:42:23 [auto1.de] INFO: Scrape type for CE50485: 0
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: DW82351
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: ZK16564
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: SM20101
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM20101%27 HTTP/1.1" 200 None
2026-03-29 10:42:23 [auto1.de] INFO: Scrape type for SM20101: 0
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: NP64585
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: RW33443
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: ZE45367
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE45367%27 HTTP/1.1" 200 None
2026-03-29 10:42:23 [auto1.de] INFO: Scrape type for ZE45367: 0
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: AF24484
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF24484%27 HTTP/1.1" 200 None
2026-03-29 10:42:23 [auto1.de] INFO: Scrape type for AF24484: 0
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: GD52714
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD52714%27 HTTP/1.1" 200 None
2026-03-29 10:42:23 [auto1.de] INFO: Scrape type for GD52714: 0
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: AK41294
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: EJ25575
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: ST81436
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST81436%27 HTTP/1.1" 200 None
2026-03-29 10:42:23 [auto1.de] INFO: Scrape type for ST81436: 0
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: EG01443
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: XE86723
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: SA71883
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA71883%27 HTTP/1.1" 200 None
2026-03-29 10:42:23 [auto1.de] INFO: Scrape type for SA71883: 0
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: ZX31727
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: VT05460
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: ZU04688
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: ED78349
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED78349%27 HTTP/1.1" 200 None
2026-03-29 10:42:23 [auto1.de] INFO: Scrape type for ED78349: 0
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: RT49707
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT49707%27 HTTP/1.1" 200 None
2026-03-29 10:42:23 [auto1.de] INFO: Scrape type for RT49707: 0
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: BF09730
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: KG76209
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG76209%27 HTTP/1.1" 200 None
2026-03-29 10:42:23 [auto1.de] INFO: Scrape type for KG76209: 0
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: RC79950
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC79950%27 HTTP/1.1" 200 None
2026-03-29 10:42:23 [auto1.de] INFO: Scrape type for RC79950: 0
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: BC36387
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC36387%27 HTTP/1.1" 200 None
2026-03-29 10:42:23 [auto1.de] INFO: Scrape type for BC36387: 0
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: JA06342
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: YK39735
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK39735%27 HTTP/1.1" 200 None
2026-03-29 10:42:23 [auto1.de] INFO: Scrape type for YK39735: 0
2026-03-29 10:42:23 [auto1.de] INFO: Found listing with ID: YF85970
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF85970%27 HTTP/1.1" 200 None
2026-03-29 10:42:23 [auto1.de] INFO: Scrape type for YF85970: 2
2026-03-29 10:42:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ba7b37e-8645-57d6-a834-024d0e89230f with identifier: YF85970
2026-03-29 10:42:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ba7b37e-8645-57d6-a834-024d0e89230f with scrape type 2
2026-03-29 10:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ba7b37e-8645-57d6-a834-024d0e89230f with scrape type 2
2026-03-29 10:42:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ba7b37e-8645-57d6-a834-024d0e89230f, identifier: YF85970
2026-03-29 10:42:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ba7b37e-8645-57d6-a834-024d0e89230f with identifier: YF85970
2026-03-29 10:42:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ba7b37e-8645-57d6-a834-024d0e89230f with identifier: YF85970
2026-03-29 10:42:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ba7b37e-8645-57d6-a834-024d0e89230f with identifier: YF85970 to the API
2026-03-29 10:42:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:42:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-30T15:00:29Z',
 'fuel_type': 'petrol',
 'id': '6ba7b37e-8645-57d6-a834-024d0e89230f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF85970',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'ASX',
 'odometer': 100217,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-31',
 'seller_name': None,
 'title': 'Mitsubishi ASX 1.6 Instyle 2WD',
 'transmission': 'manual',
 'trim': 'Instyle 2WD',
 'year': 2011}
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF85970%27 HTTP/1.1" 200 None
2026-03-29 10:42:24 [auto1.de] INFO: Saving data for YF85970: {'auction_closing_time': 1774882829.0, 'created_time': 1774596940.65839, 'last_price_update_time': 1774780944.883242}
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF85970') HTTP/1.1" 204 0
2026-03-29 10:42:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:42:24 [auto1.de] INFO: Found listing with ID: LZ35604
2026-03-29 10:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ35604%27 HTTP/1.1" 200 None
2026-03-29 10:42:25 [auto1.de] INFO: Scrape type for LZ35604: 0
2026-03-29 10:42:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:42:27 [auto1.de] INFO: Channel: 24h | Page: 104 | totalHits: 6726 | hits on page: 40
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: NB64458
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: SA20211
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA20211%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for SA20211: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: PR91039
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: BV47016
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: NU80618
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU80618%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for NU80618: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: ZY22077
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: GK53222
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: AX34994
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX34994%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for AX34994: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: KL53394
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL53394%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for KL53394: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: YC50370
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: HT24863
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: MZ26894
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: GA20411
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA20411%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for GA20411: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: XF59932
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: DV57223
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV57223%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for DV57223: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: UH91436
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH91436%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for UH91436: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: RC04315
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: XS21978
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: JV29717
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV29717%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for JV29717: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: JG70236
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: YL01247
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL01247%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for YL01247: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: XT97786
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT97786%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for XT97786: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: CY07264
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: CP03676
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: BS14183
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: CM68518
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: PL91584
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL91584%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for PL91584: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: FL51955
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: BT69693
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: ZJ17739
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: PP77608
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP77608%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for PP77608: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: BS79013
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS79013%27 HTTP/1.1" 200 None
2026-03-29 10:42:27 [auto1.de] INFO: Scrape type for BS79013: 0
2026-03-29 10:42:27 [auto1.de] INFO: Found listing with ID: DB13775
2026-03-29 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB13775%27 HTTP/1.1" 200 None
2026-03-29 10:42:28 [auto1.de] INFO: Scrape type for DB13775: 0
2026-03-29 10:42:28 [auto1.de] INFO: Found listing with ID: CR52623
2026-03-29 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR52623%27 HTTP/1.1" 200 None
2026-03-29 10:42:28 [auto1.de] INFO: Scrape type for CR52623: 0
2026-03-29 10:42:28 [auto1.de] INFO: Found listing with ID: JD13909
2026-03-29 10:42:28 [auto1.de] INFO: Found listing with ID: TF11415
2026-03-29 10:42:28 [auto1.de] INFO: Found listing with ID: LZ21667
2026-03-29 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ21667%27 HTTP/1.1" 200 None
2026-03-29 10:42:28 [auto1.de] INFO: Scrape type for LZ21667: 0
2026-03-29 10:42:28 [auto1.de] INFO: Found listing with ID: SJ57500
2026-03-29 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ57500%27 HTTP/1.1" 200 None
2026-03-29 10:42:28 [auto1.de] INFO: Scrape type for SJ57500: 0
2026-03-29 10:42:28 [auto1.de] INFO: Found listing with ID: CU14126
2026-03-29 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU14126%27 HTTP/1.1" 200 None
2026-03-29 10:42:28 [auto1.de] INFO: Scrape type for CU14126: 0
2026-03-29 10:42:28 [auto1.de] INFO: Found listing with ID: LG31115
2026-03-29 10:42:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:42:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:42:29 [auto1.de] INFO: Channel: 24h | Page: 105 | totalHits: 6726 | hits on page: 40
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: JS62021
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: KR15708
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: SP90277
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP90277%27 HTTP/1.1" 200 None
2026-03-29 10:42:29 [auto1.de] INFO: Scrape type for SP90277: 0
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: MS43037
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: KS04135
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS04135%27 HTTP/1.1" 200 None
2026-03-29 10:42:29 [auto1.de] INFO: Scrape type for KS04135: 0
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: DE35783
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: UX71045
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: VX06445
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX06445%27 HTTP/1.1" 200 None
2026-03-29 10:42:29 [auto1.de] INFO: Scrape type for VX06445: 0
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: BD42318
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD42318%27 HTTP/1.1" 200 None
2026-03-29 10:42:29 [auto1.de] INFO: Scrape type for BD42318: 0
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: WS30363
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: NS47503
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: RH48062
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH48062%27 HTTP/1.1" 200 None
2026-03-29 10:42:29 [auto1.de] INFO: Scrape type for RH48062: 0
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: CV42130
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV42130%27 HTTP/1.1" 200 None
2026-03-29 10:42:29 [auto1.de] INFO: Scrape type for CV42130: 0
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: ZY94421
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY94421%27 HTTP/1.1" 200 None
2026-03-29 10:42:29 [auto1.de] INFO: Scrape type for ZY94421: 0
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: HB69443
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: VE85293
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE85293%27 HTTP/1.1" 200 None
2026-03-29 10:42:29 [auto1.de] INFO: Scrape type for VE85293: 0
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: BU63404
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU63404%27 HTTP/1.1" 200 None
2026-03-29 10:42:29 [auto1.de] INFO: Scrape type for BU63404: 0
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: FW07623
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW07623%27 HTTP/1.1" 200 None
2026-03-29 10:42:29 [auto1.de] INFO: Scrape type for FW07623: 0
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: HT41484
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT41484%27 HTTP/1.1" 200 None
2026-03-29 10:42:29 [auto1.de] INFO: Scrape type for HT41484: 0
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: HU97464
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: FS23827
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS23827%27 HTTP/1.1" 200 None
2026-03-29 10:42:29 [auto1.de] INFO: Scrape type for FS23827: 0
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: XS31792
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS31792%27 HTTP/1.1" 200 None
2026-03-29 10:42:29 [auto1.de] INFO: Scrape type for XS31792: 0
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: EB16360
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: MH67874
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: TP43988
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP43988%27 HTTP/1.1" 200 None
2026-03-29 10:42:29 [auto1.de] INFO: Scrape type for TP43988: 0
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: FY91638
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: DZ95000
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ95000%27 HTTP/1.1" 200 None
2026-03-29 10:42:29 [auto1.de] INFO: Scrape type for DZ95000: 0
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: TS65125
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS65125%27 HTTP/1.1" 200 None
2026-03-29 10:42:29 [auto1.de] INFO: Scrape type for TS65125: 0
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: ZV59345
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV59345%27 HTTP/1.1" 200 None
2026-03-29 10:42:29 [auto1.de] INFO: Scrape type for ZV59345: 0
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: SC05662
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: MH02928
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH02928%27 HTTP/1.1" 200 None
2026-03-29 10:42:29 [auto1.de] INFO: Scrape type for MH02928: 0
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: KL31894
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: LJ25483
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: XT54020
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT54020%27 HTTP/1.1" 200 None
2026-03-29 10:42:29 [auto1.de] INFO: Scrape type for XT54020: 0
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: WR03810
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR03810%27 HTTP/1.1" 200 None
2026-03-29 10:42:29 [auto1.de] INFO: Scrape type for WR03810: 0
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: LF03511
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: RC37998
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: RV91936
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: CS21396
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS21396%27 HTTP/1.1" 200 None
2026-03-29 10:42:29 [auto1.de] INFO: Scrape type for CS21396: 0
2026-03-29 10:42:29 [auto1.de] INFO: Found listing with ID: HA98136
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA98136%27 HTTP/1.1" 200 None
2026-03-29 10:42:29 [auto1.de] INFO: Scrape type for HA98136: 0
2026-03-29 10:42:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:42:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:42:33 [auto1.de] INFO: Channel: 24h | Page: 106 | totalHits: 6726 | hits on page: 40
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: BV72825
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: XX95177
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX95177%27 HTTP/1.1" 200 None
2026-03-29 10:42:33 [auto1.de] INFO: Scrape type for XX95177: 0
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: FY17492
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: KA91193
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA91193%27 HTTP/1.1" 200 None
2026-03-29 10:42:33 [auto1.de] INFO: Scrape type for KA91193: 0
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: CF22867
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF22867%27 HTTP/1.1" 200 None
2026-03-29 10:42:33 [auto1.de] INFO: Scrape type for CF22867: 0
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: GU64592
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: RX78682
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: UH14154
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH14154%27 HTTP/1.1" 200 None
2026-03-29 10:42:33 [auto1.de] INFO: Scrape type for UH14154: 0
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: MB08927
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB08927%27 HTTP/1.1" 200 None
2026-03-29 10:42:33 [auto1.de] INFO: Scrape type for MB08927: 0
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: UP35116
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: NN79660
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN79660%27 HTTP/1.1" 200 None
2026-03-29 10:42:33 [auto1.de] INFO: Scrape type for NN79660: 0
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: SV37503
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: FB02409
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB02409%27 HTTP/1.1" 200 None
2026-03-29 10:42:33 [auto1.de] INFO: Scrape type for FB02409: 0
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: FK58652
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK58652%27 HTTP/1.1" 200 None
2026-03-29 10:42:33 [auto1.de] INFO: Scrape type for FK58652: 0
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: SV69696
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: XJ83535
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ83535%27 HTTP/1.1" 200 None
2026-03-29 10:42:33 [auto1.de] INFO: Scrape type for XJ83535: 0
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: AU13367
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU13367%27 HTTP/1.1" 200 None
2026-03-29 10:42:33 [auto1.de] INFO: Scrape type for AU13367: 0
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: BA36034
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: HS09512
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS09512%27 HTTP/1.1" 200 None
2026-03-29 10:42:33 [auto1.de] INFO: Scrape type for HS09512: 0
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: RV14336
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV14336%27 HTTP/1.1" 200 None
2026-03-29 10:42:33 [auto1.de] INFO: Scrape type for RV14336: 0
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: GT54130
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: YZ03964
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ03964%27 HTTP/1.1" 200 None
2026-03-29 10:42:33 [auto1.de] INFO: Scrape type for YZ03964: 0
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: TB33384
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB33384%27 HTTP/1.1" 200 None
2026-03-29 10:42:33 [auto1.de] INFO: Scrape type for TB33384: 0
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: GY64031
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY64031%27 HTTP/1.1" 200 None
2026-03-29 10:42:33 [auto1.de] INFO: Scrape type for GY64031: 0
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: BM71162
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM71162%27 HTTP/1.1" 200 None
2026-03-29 10:42:33 [auto1.de] INFO: Scrape type for BM71162: 0
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: KS78216
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS78216%27 HTTP/1.1" 200 None
2026-03-29 10:42:33 [auto1.de] INFO: Scrape type for KS78216: 0
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: BX38798
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: ZD80559
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: RF27065
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF27065%27 HTTP/1.1" 200 None
2026-03-29 10:42:33 [auto1.de] INFO: Scrape type for RF27065: 0
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: ZD36450
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: ZS85810
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS85810%27 HTTP/1.1" 200 None
2026-03-29 10:42:33 [auto1.de] INFO: Scrape type for ZS85810: 0
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: DJ74321
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: EU72034
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: AY25775
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY25775%27 HTTP/1.1" 200 None
2026-03-29 10:42:33 [auto1.de] INFO: Scrape type for AY25775: 0
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: XP68837
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP68837%27 HTTP/1.1" 200 None
2026-03-29 10:42:33 [auto1.de] INFO: Scrape type for XP68837: 0
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: YF32306
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: PK18306
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: NX37466
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX37466%27 HTTP/1.1" 200 None
2026-03-29 10:42:33 [auto1.de] INFO: Scrape type for NX37466: 0
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: UK63230
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK63230%27 HTTP/1.1" 200 None
2026-03-29 10:42:33 [auto1.de] INFO: Scrape type for UK63230: 0
2026-03-29 10:42:33 [auto1.de] INFO: Found listing with ID: PK39186
2026-03-29 10:42:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:42:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:42:36 [auto1.de] INFO: Channel: 24h | Page: 107 | totalHits: 6726 | hits on page: 40
2026-03-29 10:42:36 [auto1.de] INFO: Found listing with ID: RG82987
2026-03-29 10:42:36 [auto1.de] INFO: Found listing with ID: WH66881
2026-03-29 10:42:36 [auto1.de] INFO: Found listing with ID: XN11461
2026-03-29 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN11461%27 HTTP/1.1" 200 None
2026-03-29 10:42:36 [auto1.de] INFO: Scrape type for XN11461: 2
2026-03-29 10:42:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3ed502f-5fb2-550e-b9bc-f4f8804a11e4 with identifier: XN11461
2026-03-29 10:42:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3ed502f-5fb2-550e-b9bc-f4f8804a11e4 with scrape type 2
2026-03-29 10:42:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3ed502f-5fb2-550e-b9bc-f4f8804a11e4 with scrape type 2
2026-03-29 10:42:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3ed502f-5fb2-550e-b9bc-f4f8804a11e4, identifier: XN11461
2026-03-29 10:42:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3ed502f-5fb2-550e-b9bc-f4f8804a11e4 with identifier: XN11461
2026-03-29 10:42:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3ed502f-5fb2-550e-b9bc-f4f8804a11e4 with identifier: XN11461
2026-03-29 10:42:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3ed502f-5fb2-550e-b9bc-f4f8804a11e4 with identifier: XN11461 to the API
2026-03-29 10:42:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:42:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:37:07Z',
 'fuel_type': 'diesel',
 'id': 'a3ed502f-5fb2-550e-b9bc-f4f8804a11e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN11461',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 360930,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-08',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2013}
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN11461%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Saving data for XN11461: {'auction_closing_time': 1774885027.0, 'created_time': 1773831612.340969, 'last_price_update_time': 1774780957.419727}
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XN11461') HTTP/1.1" 204 0
2026-03-29 10:42:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: EL53532
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL53532%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for EL53532: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: LA48706
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA48706%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for LA48706: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: ND02727
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: WJ18132
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: PS90319
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS90319%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for PS90319: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: RJ18784
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ18784%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for RJ18784: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: HW74456
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW74456%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for HW74456: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: YT31718
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT31718%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for YT31718: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: BA02242
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA02242%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for BA02242: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: JR30174
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: MX79326
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX79326%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for MX79326: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: YJ23133
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: XP57282
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP57282%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for XP57282: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: XU09743
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: XR37106
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR37106%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for XR37106: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: CZ08846
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ08846%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for CZ08846: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: SX51992
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: MR02811
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR02811%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for MR02811: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: KT07926
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: MC50567
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: NY75190
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: WZ46352
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: SS68419
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: CU12004
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU12004%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for CU12004: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: KW63428
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW63428%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for KW63428: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: VX83538
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX83538%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for VX83538: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: TD91904
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: JG67628
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: SG68469
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG68469%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for SG68469: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: FP97739
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: JK39186
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: FB09525
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: MB29022
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB29022%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for MB29022: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: KF96570
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF96570%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for KF96570: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: HG82543
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: LM29335
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM29335%27 HTTP/1.1" 200 None
2026-03-29 10:42:37 [auto1.de] INFO: Scrape type for LM29335: 0
2026-03-29 10:42:37 [auto1.de] INFO: Found listing with ID: KX42000
2026-03-29 10:42:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:42:41 [auto1.de] INFO: Channel: 24h | Page: 108 | totalHits: 6726 | hits on page: 40
2026-03-29 10:42:41 [auto1.de] INFO: Found listing with ID: YH85992
2026-03-29 10:42:41 [auto1.de] INFO: Found listing with ID: KY48204
2026-03-29 10:42:41 [auto1.de] INFO: Found listing with ID: TS36559
2026-03-29 10:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS36559%27 HTTP/1.1" 200 None
2026-03-29 10:42:42 [auto1.de] INFO: Scrape type for TS36559: 0
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: HL48230
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: UY59901
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: PS42902
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: GG07111
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: NR01003
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: TJ52471
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: JG35901
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35901%27 HTTP/1.1" 200 None
2026-03-29 10:42:42 [auto1.de] INFO: Scrape type for JG35901: 0
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: LB47051
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: BB05749
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: MM26865
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM26865%27 HTTP/1.1" 200 None
2026-03-29 10:42:42 [auto1.de] INFO: Scrape type for MM26865: 0
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: DG62846
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG62846%27 HTTP/1.1" 200 None
2026-03-29 10:42:42 [auto1.de] INFO: Scrape type for DG62846: 0
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: KZ05104
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ05104%27 HTTP/1.1" 200 None
2026-03-29 10:42:42 [auto1.de] INFO: Scrape type for KZ05104: 0
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: BS47149
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS47149%27 HTTP/1.1" 200 None
2026-03-29 10:42:42 [auto1.de] INFO: Scrape type for BS47149: 0
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: AU38078
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: AS09440
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS09440%27 HTTP/1.1" 200 None
2026-03-29 10:42:42 [auto1.de] INFO: Scrape type for AS09440: 0
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: KX86126
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX86126%27 HTTP/1.1" 200 None
2026-03-29 10:42:42 [auto1.de] INFO: Scrape type for KX86126: 0
2026-03-29 10:42:42 [auto1.de] INFO: Found listing with ID: SW86673
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW86673%27 HTTP/1.1" 200 None
2026-03-29 10:42:42 [auto1.de] INFO: Scrape type for SW86673: 2
2026-03-29 10:42:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35341618-13a7-5cb5-a1b4-395d3318c4a8 with identifier: SW86673
2026-03-29 10:42:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35341618-13a7-5cb5-a1b4-395d3318c4a8 with scrape type 2
2026-03-29 10:42:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35341618-13a7-5cb5-a1b4-395d3318c4a8 with scrape type 2
2026-03-29 10:42:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 35341618-13a7-5cb5-a1b4-395d3318c4a8, identifier: SW86673
2026-03-29 10:42:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 35341618-13a7-5cb5-a1b4-395d3318c4a8 with identifier: SW86673
2026-03-29 10:42:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 35341618-13a7-5cb5-a1b4-395d3318c4a8 with identifier: SW86673
2026-03-29 10:42:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 35341618-13a7-5cb5-a1b4-395d3318c4a8 with identifier: SW86673 to the API
2026-03-29 10:42:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:42:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:42:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:47:08Z',
 'fuel_type': 'petrol',
 'id': '35341618-13a7-5cb5-a1b4-395d3318c4a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW86673',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 284606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-24',
 'seller_name': None,
 'title': 'Ford Grand C-Max 1.6 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2012}
2026-03-29 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW86673%27 HTTP/1.1" 200 None
2026-03-29 10:42:43 [auto1.de] INFO: Saving data for SW86673: {'auction_closing_time': 1774885628.0, 'created_time': 1773383311.01312, 'last_price_update_time': 1774780963.458095}
2026-03-29 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SW86673') HTTP/1.1" 204 0
2026-03-29 10:42:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:42:43 [auto1.de] INFO: Found listing with ID: BV96040
2026-03-29 10:42:43 [auto1.de] INFO: Found listing with ID: FW84065
2026-03-29 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW84065%27 HTTP/1.1" 200 None
2026-03-29 10:42:43 [auto1.de] INFO: Scrape type for FW84065: 0
2026-03-29 10:42:43 [auto1.de] INFO: Found listing with ID: ND74491
2026-03-29 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND74491%27 HTTP/1.1" 200 None
2026-03-29 10:42:43 [auto1.de] INFO: Scrape type for ND74491: 0
2026-03-29 10:42:43 [auto1.de] INFO: Found listing with ID: KM26302
2026-03-29 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM26302%27 HTTP/1.1" 200 None
2026-03-29 10:42:43 [auto1.de] INFO: Scrape type for KM26302: 0
2026-03-29 10:42:43 [auto1.de] INFO: Found listing with ID: FK93583
2026-03-29 10:42:43 [auto1.de] INFO: Found listing with ID: MF11383
2026-03-29 10:42:43 [auto1.de] INFO: Found listing with ID: SK36887
2026-03-29 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK36887%27 HTTP/1.1" 200 None
2026-03-29 10:42:43 [auto1.de] INFO: Scrape type for SK36887: 0
2026-03-29 10:42:43 [auto1.de] INFO: Found listing with ID: FB70760
2026-03-29 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB70760%27 HTTP/1.1" 200 None
2026-03-29 10:42:43 [auto1.de] INFO: Scrape type for FB70760: 0
2026-03-29 10:42:43 [auto1.de] INFO: Found listing with ID: CA11296
2026-03-29 10:42:43 [auto1.de] INFO: Found listing with ID: TV20692
2026-03-29 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV20692%27 HTTP/1.1" 200 None
2026-03-29 10:42:43 [auto1.de] INFO: Scrape type for TV20692: 0
2026-03-29 10:42:43 [auto1.de] INFO: Found listing with ID: RC52895
2026-03-29 10:42:43 [auto1.de] INFO: Found listing with ID: LV55762
2026-03-29 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV55762%27 HTTP/1.1" 200 None
2026-03-29 10:42:43 [auto1.de] INFO: Scrape type for LV55762: 0
2026-03-29 10:42:43 [auto1.de] INFO: Found listing with ID: HT64251
2026-03-29 10:42:43 [auto1.de] INFO: Found listing with ID: CV64840
2026-03-29 10:42:43 [auto1.de] INFO: Found listing with ID: KH49369
2026-03-29 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH49369%27 HTTP/1.1" 200 None
2026-03-29 10:42:43 [auto1.de] INFO: Scrape type for KH49369: 0
2026-03-29 10:42:43 [auto1.de] INFO: Found listing with ID: LT46739
2026-03-29 10:42:43 [auto1.de] INFO: Found listing with ID: AS68475
2026-03-29 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS68475%27 HTTP/1.1" 200 None
2026-03-29 10:42:43 [auto1.de] INFO: Scrape type for AS68475: 2
2026-03-29 10:42:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 109df886-ff4d-5331-b6d9-47070ddbdf1a with identifier: AS68475
2026-03-29 10:42:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 109df886-ff4d-5331-b6d9-47070ddbdf1a with scrape type 2
2026-03-29 10:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 109df886-ff4d-5331-b6d9-47070ddbdf1a with scrape type 2
2026-03-29 10:42:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 109df886-ff4d-5331-b6d9-47070ddbdf1a, identifier: AS68475
2026-03-29 10:42:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 109df886-ff4d-5331-b6d9-47070ddbdf1a with identifier: AS68475
2026-03-29 10:42:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 109df886-ff4d-5331-b6d9-47070ddbdf1a with identifier: AS68475
2026-03-29 10:42:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 109df886-ff4d-5331-b6d9-47070ddbdf1a with identifier: AS68475 to the API
2026-03-29 10:42:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:42:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:42:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:12:17Z',
 'fuel_type': 'diesel',
 'id': '109df886-ff4d-5331-b6d9-47070ddbdf1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS68475',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 211699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-05',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-29 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS68475%27 HTTP/1.1" 200 None
2026-03-29 10:42:44 [auto1.de] INFO: Saving data for AS68475: {'auction_closing_time': 1774883537.0, 'created_time': 1774596938.65833, 'last_price_update_time': 1774780964.119878}
2026-03-29 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AS68475') HTTP/1.1" 204 0
2026-03-29 10:42:44 [auto1.de] INFO: Found listing with ID: EL15513
2026-03-29 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL15513%27 HTTP/1.1" 200 None
2026-03-29 10:42:44 [auto1.de] INFO: Scrape type for EL15513: 0
2026-03-29 10:42:44 [auto1.de] INFO: Found listing with ID: FY57679
2026-03-29 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY57679%27 HTTP/1.1" 200 None
2026-03-29 10:42:44 [auto1.de] INFO: Scrape type for FY57679: 0
2026-03-29 10:42:44 [auto1.de] INFO: Found listing with ID: YK97708
2026-03-29 10:42:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:42:51 [auto1.de] INFO: Channel: 24h | Page: 109 | totalHits: 6726 | hits on page: 40
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: WR45011
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: YR50974
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR50974%27 HTTP/1.1" 200 None
2026-03-29 10:42:51 [auto1.de] INFO: Scrape type for YR50974: 0
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: AU97741
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: XE57640
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: HX44464
2026-03-29 10:42:51 [auto1.de] INFO: Found listing with ID: BB57132
2026-03-29 10:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB57132%27 HTTP/1.1" 200 None
2026-03-29 10:42:52 [auto1.de] INFO: Scrape type for BB57132: 0
2026-03-29 10:42:52 [auto1.de] INFO: Found listing with ID: TG41026
2026-03-29 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG41026%27 HTTP/1.1" 200 None
2026-03-29 10:42:52 [auto1.de] INFO: Scrape type for TG41026: 0
2026-03-29 10:42:52 [auto1.de] INFO: Found listing with ID: XH41107
2026-03-29 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH41107%27 HTTP/1.1" 200 None
2026-03-29 10:42:52 [auto1.de] INFO: Scrape type for XH41107: 0
2026-03-29 10:42:52 [auto1.de] INFO: Found listing with ID: WD55568
2026-03-29 10:42:52 [auto1.de] INFO: Found listing with ID: TT11512
2026-03-29 10:42:52 [auto1.de] INFO: Found listing with ID: MA81482
2026-03-29 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA81482%27 HTTP/1.1" 200 None
2026-03-29 10:42:52 [auto1.de] INFO: Scrape type for MA81482: 0
2026-03-29 10:42:52 [auto1.de] INFO: Found listing with ID: EH89058
2026-03-29 10:42:52 [auto1.de] INFO: Found listing with ID: DR63212
2026-03-29 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR63212%27 HTTP/1.1" 200 None
2026-03-29 10:42:52 [auto1.de] INFO: Scrape type for DR63212: 0
2026-03-29 10:42:52 [auto1.de] INFO: Found listing with ID: YU70640
2026-03-29 10:42:52 [auto1.de] INFO: Found listing with ID: BS68722
2026-03-29 10:42:52 [auto1.de] INFO: Found listing with ID: KR59987
2026-03-29 10:42:52 [auto1.de] INFO: Found listing with ID: XA59954
2026-03-29 10:42:52 [auto1.de] INFO: Found listing with ID: GV00084
2026-03-29 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV00084%27 HTTP/1.1" 200 None
2026-03-29 10:42:52 [auto1.de] INFO: Scrape type for GV00084: 0
2026-03-29 10:42:52 [auto1.de] INFO: Found listing with ID: WV53584
2026-03-29 10:42:52 [auto1.de] INFO: Found listing with ID: UC15982
2026-03-29 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC15982%27 HTTP/1.1" 200 None
2026-03-29 10:42:52 [auto1.de] INFO: Scrape type for UC15982: 0
2026-03-29 10:42:52 [auto1.de] INFO: Found listing with ID: NV35825
2026-03-29 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV35825%27 HTTP/1.1" 200 None
2026-03-29 10:42:52 [auto1.de] INFO: Scrape type for NV35825: 0
2026-03-29 10:42:52 [auto1.de] INFO: Found listing with ID: HX82785
2026-03-29 10:42:52 [auto1.de] INFO: Found listing with ID: ZL89302
2026-03-29 10:42:52 [auto1.de] INFO: Found listing with ID: XS67256
2026-03-29 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS67256%27 HTTP/1.1" 200 None
2026-03-29 10:42:52 [auto1.de] INFO: Scrape type for XS67256: 0
2026-03-29 10:42:52 [auto1.de] INFO: Found listing with ID: KP94641
2026-03-29 10:42:52 [auto1.de] INFO: Found listing with ID: FK64701
2026-03-29 10:42:52 [auto1.de] INFO: Found listing with ID: TJ54274
2026-03-29 10:42:52 [auto1.de] INFO: Found listing with ID: KD99837
2026-03-29 10:42:52 [auto1.de] INFO: Found listing with ID: BP65975
2026-03-29 10:42:52 [auto1.de] INFO: Found listing with ID: GN84809
2026-03-29 10:42:52 [auto1.de] INFO: Found listing with ID: GT92909
2026-03-29 10:42:52 [auto1.de] INFO: Found listing with ID: US02416
2026-03-29 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US02416%27 HTTP/1.1" 200 None
2026-03-29 10:42:52 [auto1.de] INFO: Scrape type for US02416: 0
2026-03-29 10:42:52 [auto1.de] INFO: Found listing with ID: JT79226
2026-03-29 10:42:52 [auto1.de] INFO: Found listing with ID: SL77379
2026-03-29 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL77379%27 HTTP/1.1" 200 None
2026-03-29 10:42:52 [auto1.de] INFO: Scrape type for SL77379: 0
2026-03-29 10:42:52 [auto1.de] INFO: Found listing with ID: SP71400
2026-03-29 10:42:52 [auto1.de] INFO: Found listing with ID: WE95129
2026-03-29 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE95129%27 HTTP/1.1" 200 None
2026-03-29 10:42:52 [auto1.de] INFO: Scrape type for WE95129: 0
2026-03-29 10:42:52 [auto1.de] INFO: Found listing with ID: BJ13428
2026-03-29 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ13428%27 HTTP/1.1" 200 None
2026-03-29 10:42:52 [auto1.de] INFO: Scrape type for BJ13428: 0
2026-03-29 10:42:52 [auto1.de] INFO: Found listing with ID: VR69124
2026-03-29 10:42:52 [auto1.de] INFO: Found listing with ID: ZS85358
2026-03-29 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS85358%27 HTTP/1.1" 200 None
2026-03-29 10:42:52 [auto1.de] INFO: Scrape type for ZS85358: 0
2026-03-29 10:42:52 [auto1.de] INFO: Found listing with ID: TB03124
2026-03-29 10:42:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:42:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:42:53 [auto1.de] INFO: Channel: 24h | Page: 110 | totalHits: 6726 | hits on page: 40
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: FC27244
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: CR76399
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: EY70159
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: ZN04335
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: YT62931
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT62931%27 HTTP/1.1" 200 None
2026-03-29 10:42:53 [auto1.de] INFO: Scrape type for YT62931: 0
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: SR63884
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: MR29539
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: ZA74558
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: UL19330
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: EM38204
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: WV85362
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV85362%27 HTTP/1.1" 200 None
2026-03-29 10:42:53 [auto1.de] INFO: Scrape type for WV85362: 0
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: LN73181
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN73181%27 HTTP/1.1" 200 None
2026-03-29 10:42:53 [auto1.de] INFO: Scrape type for LN73181: 0
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: DH60406
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: LV98525
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: DR68264
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR68264%27 HTTP/1.1" 200 None
2026-03-29 10:42:53 [auto1.de] INFO: Scrape type for DR68264: 0
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: MP23640
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP23640%27 HTTP/1.1" 200 None
2026-03-29 10:42:53 [auto1.de] INFO: Scrape type for MP23640: 0
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: FF90181
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: PS26933
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: KK20650
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: ZT51756
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: FP07382
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP07382%27 HTTP/1.1" 200 None
2026-03-29 10:42:53 [auto1.de] INFO: Scrape type for FP07382: 0
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: VG01076
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: AV64816
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV64816%27 HTTP/1.1" 200 None
2026-03-29 10:42:53 [auto1.de] INFO: Scrape type for AV64816: 0
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: AJ08508
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: WT94690
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: JW09174
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: XL45586
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: JF78286
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: FX01006
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX01006%27 HTTP/1.1" 200 None
2026-03-29 10:42:53 [auto1.de] INFO: Scrape type for FX01006: 0
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: LU78971
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: DE42572
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: JH92340
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: MH95503
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH95503%27 HTTP/1.1" 200 None
2026-03-29 10:42:53 [auto1.de] INFO: Scrape type for MH95503: 0
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: NS04983
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: MM23773
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: KS07911
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS07911%27 HTTP/1.1" 200 None
2026-03-29 10:42:53 [auto1.de] INFO: Scrape type for KS07911: 0
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: FY22177
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: ZS84546
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: PP80168
2026-03-29 10:42:53 [auto1.de] INFO: Found listing with ID: JL01177
2026-03-29 10:42:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:42:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:42:55 [auto1.de] INFO: Channel: 24h | Page: 111 | totalHits: 6726 | hits on page: 40
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: EY62389
2026-03-29 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY62389%27 HTTP/1.1" 200 None
2026-03-29 10:42:55 [auto1.de] INFO: Scrape type for EY62389: 0
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: BD72910
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: RC80403
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: NG76002
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: AJ71122
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: MV27472
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: GB27977
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: DM13382
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: NY59732
2026-03-29 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY59732%27 HTTP/1.1" 200 None
2026-03-29 10:42:55 [auto1.de] INFO: Scrape type for NY59732: 0
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: XR73410
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: FX39792
2026-03-29 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX39792%27 HTTP/1.1" 200 None
2026-03-29 10:42:55 [auto1.de] INFO: Scrape type for FX39792: 0
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: CN74001
2026-03-29 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN74001%27 HTTP/1.1" 200 None
2026-03-29 10:42:55 [auto1.de] INFO: Scrape type for CN74001: 0
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: PR32906
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: BG13835
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: GR89322
2026-03-29 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR89322%27 HTTP/1.1" 200 None
2026-03-29 10:42:55 [auto1.de] INFO: Scrape type for GR89322: 0
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: KX79678
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: BJ03907
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: BE52525
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: ZD84444
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: AR51863
2026-03-29 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR51863%27 HTTP/1.1" 200 None
2026-03-29 10:42:55 [auto1.de] INFO: Scrape type for AR51863: 0
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: ZP29614
2026-03-29 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP29614%27 HTTP/1.1" 200 None
2026-03-29 10:42:55 [auto1.de] INFO: Scrape type for ZP29614: 0
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: AS79616
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: KY24056
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: KH41700
2026-03-29 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH41700%27 HTTP/1.1" 200 None
2026-03-29 10:42:55 [auto1.de] INFO: Scrape type for KH41700: 0
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: WT06572
2026-03-29 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT06572%27 HTTP/1.1" 200 None
2026-03-29 10:42:55 [auto1.de] INFO: Scrape type for WT06572: 0
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: RK05347
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: CY25945
2026-03-29 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY25945%27 HTTP/1.1" 200 None
2026-03-29 10:42:55 [auto1.de] INFO: Scrape type for CY25945: 0
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: XC86778
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: CZ94450
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: FD07804
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: EU14663
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: MK09620
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: GH39417
2026-03-29 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH39417%27 HTTP/1.1" 200 None
2026-03-29 10:42:55 [auto1.de] INFO: Scrape type for GH39417: 0
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: BS96565
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: FK93420
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: TP67168
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: AU39005
2026-03-29 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU39005%27 HTTP/1.1" 200 None
2026-03-29 10:42:55 [auto1.de] INFO: Scrape type for AU39005: 0
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: AL71232
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: CP06535
2026-03-29 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP06535%27 HTTP/1.1" 200 None
2026-03-29 10:42:55 [auto1.de] INFO: Scrape type for CP06535: 0
2026-03-29 10:42:55 [auto1.de] INFO: Found listing with ID: EU93663
2026-03-29 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU93663%27 HTTP/1.1" 200 None
2026-03-29 10:42:55 [auto1.de] INFO: Scrape type for EU93663: 0
2026-03-29 10:42:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:43:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:43:01 [auto1.de] INFO: Channel: 24h | Page: 112 | totalHits: 6726 | hits on page: 40
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: AZ37362
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ37362%27 HTTP/1.1" 200 None
2026-03-29 10:43:01 [auto1.de] INFO: Scrape type for AZ37362: 0
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: DJ60943
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ60943%27 HTTP/1.1" 200 None
2026-03-29 10:43:01 [auto1.de] INFO: Scrape type for DJ60943: 0
2026-03-29 10:43:01 [auto1.de] INFO: Found listing with ID: YD94034
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD94034%27 HTTP/1.1" 200 None
2026-03-29 10:43:01 [auto1.de] INFO: Scrape type for YD94034: 2
2026-03-29 10:43:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4503613a-afd0-52bf-b7c5-43e77f74da28 with identifier: YD94034
2026-03-29 10:43:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4503613a-afd0-52bf-b7c5-43e77f74da28 with scrape type 2
2026-03-29 10:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4503613a-afd0-52bf-b7c5-43e77f74da28 with scrape type 2
2026-03-29 10:43:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4503613a-afd0-52bf-b7c5-43e77f74da28, identifier: YD94034
2026-03-29 10:43:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4503613a-afd0-52bf-b7c5-43e77f74da28 with identifier: YD94034
2026-03-29 10:43:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4503613a-afd0-52bf-b7c5-43e77f74da28 with identifier: YD94034
2026-03-29 10:43:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4503613a-afd0-52bf-b7c5-43e77f74da28 with identifier: YD94034 to the API
2026-03-29 10:43:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:02:22Z',
 'fuel_type': 'petrol',
 'id': '4503613a-afd0-52bf-b7c5-43e77f74da28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD94034',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 53753,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-12',
 'seller_name': None,
 'title': 'BMW 3er 328i',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD94034%27 HTTP/1.1" 200 None
2026-03-29 10:43:03 [auto1.de] INFO: Saving data for YD94034: {'auction_closing_time': 1774882942.0, 'created_time': 1773136346.902415, 'last_price_update_time': 1774780983.203974}
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YD94034') HTTP/1.1" 204 0
2026-03-29 10:43:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: YH93335
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: EE47026
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE47026%27 HTTP/1.1" 200 None
2026-03-29 10:43:03 [auto1.de] INFO: Scrape type for EE47026: 0
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: YA08526
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: ML30380
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML30380%27 HTTP/1.1" 200 None
2026-03-29 10:43:03 [auto1.de] INFO: Scrape type for ML30380: 0
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: EJ97789
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ97789%27 HTTP/1.1" 200 None
2026-03-29 10:43:03 [auto1.de] INFO: Scrape type for EJ97789: 0
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: VC89740
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC89740%27 HTTP/1.1" 200 None
2026-03-29 10:43:03 [auto1.de] INFO: Scrape type for VC89740: 0
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: YM60092
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: HA99169
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: NC07165
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC07165%27 HTTP/1.1" 200 None
2026-03-29 10:43:03 [auto1.de] INFO: Scrape type for NC07165: 0
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: GU28360
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: GL23432
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: NY39865
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: RA07752
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA07752%27 HTTP/1.1" 200 None
2026-03-29 10:43:03 [auto1.de] INFO: Scrape type for RA07752: 0
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: YM89123
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: AG84988
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG84988%27 HTTP/1.1" 200 None
2026-03-29 10:43:03 [auto1.de] INFO: Scrape type for AG84988: 0
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: JE20553
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: UY21095
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY21095%27 HTTP/1.1" 200 None
2026-03-29 10:43:03 [auto1.de] INFO: Scrape type for UY21095: 0
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: HE95833
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: WG73343
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG73343%27 HTTP/1.1" 200 None
2026-03-29 10:43:03 [auto1.de] INFO: Scrape type for WG73343: 0
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: VU06993
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU06993%27 HTTP/1.1" 200 None
2026-03-29 10:43:03 [auto1.de] INFO: Scrape type for VU06993: 0
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: SD64601
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD64601%27 HTTP/1.1" 200 None
2026-03-29 10:43:03 [auto1.de] INFO: Scrape type for SD64601: 0
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: ME01390
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME01390%27 HTTP/1.1" 200 None
2026-03-29 10:43:03 [auto1.de] INFO: Scrape type for ME01390: 0
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: BH40486
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: FC58368
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: PJ72661
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: EU55937
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: TL72428
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: TR16166
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: NK37699
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK37699%27 HTTP/1.1" 200 None
2026-03-29 10:43:03 [auto1.de] INFO: Scrape type for NK37699: 0
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: CT75216
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: RB67874
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB67874%27 HTTP/1.1" 200 None
2026-03-29 10:43:03 [auto1.de] INFO: Scrape type for RB67874: 0
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: HG88240
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG88240%27 HTTP/1.1" 200 None
2026-03-29 10:43:03 [auto1.de] INFO: Scrape type for HG88240: 0
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: CN22561
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: JR29139
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR29139%27 HTTP/1.1" 200 None
2026-03-29 10:43:03 [auto1.de] INFO: Scrape type for JR29139: 0
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: UA34873
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA34873%27 HTTP/1.1" 200 None
2026-03-29 10:43:03 [auto1.de] INFO: Scrape type for UA34873: 0
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: ZH54779
2026-03-29 10:43:03 [auto1.de] INFO: Found listing with ID: NV84142
2026-03-29 10:43:06 [scrapy.extensions.logstats] INFO: Crawled 174 pages (at 15 pages/min), scraped 252 items (at 7 items/min)
2026-03-29 10:43:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 160MiB
2026-03-29 10:43:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:43:10 [auto1.de] INFO: Channel: 24h | Page: 113 | totalHits: 6726 | hits on page: 40
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: KV75239
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: CE75609
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE75609%27 HTTP/1.1" 200 None
2026-03-29 10:43:10 [auto1.de] INFO: Scrape type for CE75609: 0
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: WN20430
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: CP55762
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: XA05617
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA05617%27 HTTP/1.1" 200 None
2026-03-29 10:43:10 [auto1.de] INFO: Scrape type for XA05617: 0
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: MX54402
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX54402%27 HTTP/1.1" 200 None
2026-03-29 10:43:10 [auto1.de] INFO: Scrape type for MX54402: 0
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: ES68108
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES68108%27 HTTP/1.1" 200 None
2026-03-29 10:43:10 [auto1.de] INFO: Scrape type for ES68108: 0
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: CF39305
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF39305%27 HTTP/1.1" 200 None
2026-03-29 10:43:10 [auto1.de] INFO: Scrape type for CF39305: 0
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: UE30876
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: EY98011
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: TY32384
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY32384%27 HTTP/1.1" 200 None
2026-03-29 10:43:10 [auto1.de] INFO: Scrape type for TY32384: 0
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: HW68760
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW68760%27 HTTP/1.1" 200 None
2026-03-29 10:43:10 [auto1.de] INFO: Scrape type for HW68760: 0
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: MK93259
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: JT09686
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: AH85059
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH85059%27 HTTP/1.1" 200 None
2026-03-29 10:43:10 [auto1.de] INFO: Scrape type for AH85059: 0
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: LZ51858
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ51858%27 HTTP/1.1" 200 None
2026-03-29 10:43:10 [auto1.de] INFO: Scrape type for LZ51858: 0
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: MS39817
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS39817%27 HTTP/1.1" 200 None
2026-03-29 10:43:10 [auto1.de] INFO: Scrape type for MS39817: 0
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: CB40051
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: YM15583
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM15583%27 HTTP/1.1" 200 None
2026-03-29 10:43:10 [auto1.de] INFO: Scrape type for YM15583: 0
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: TD61700
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD61700%27 HTTP/1.1" 200 None
2026-03-29 10:43:10 [auto1.de] INFO: Scrape type for TD61700: 0
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: NY21344
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: NS09930
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: AD93379
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD93379%27 HTTP/1.1" 200 None
2026-03-29 10:43:10 [auto1.de] INFO: Scrape type for AD93379: 0
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: HB70808
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: VN62534
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN62534%27 HTTP/1.1" 200 None
2026-03-29 10:43:10 [auto1.de] INFO: Scrape type for VN62534: 0
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: MP24640
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP24640%27 HTTP/1.1" 200 None
2026-03-29 10:43:10 [auto1.de] INFO: Scrape type for MP24640: 0
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: HL07149
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: XR43208
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: BR25220
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR25220%27 HTTP/1.1" 200 None
2026-03-29 10:43:10 [auto1.de] INFO: Scrape type for BR25220: 0
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: SM54936
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM54936%27 HTTP/1.1" 200 None
2026-03-29 10:43:10 [auto1.de] INFO: Scrape type for SM54936: 0
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: LA11075
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: CG81314
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG81314%27 HTTP/1.1" 200 None
2026-03-29 10:43:10 [auto1.de] INFO: Scrape type for CG81314: 0
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: BX54451
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: UK08756
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK08756%27 HTTP/1.1" 200 None
2026-03-29 10:43:10 [auto1.de] INFO: Scrape type for UK08756: 0
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: KN66940
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN66940%27 HTTP/1.1" 200 None
2026-03-29 10:43:10 [auto1.de] INFO: Scrape type for KN66940: 0
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: CR88792
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR88792%27 HTTP/1.1" 200 None
2026-03-29 10:43:10 [auto1.de] INFO: Scrape type for CR88792: 0
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: CZ66164
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ66164%27 HTTP/1.1" 200 None
2026-03-29 10:43:10 [auto1.de] INFO: Scrape type for CZ66164: 0
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: UB65858
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB65858%27 HTTP/1.1" 200 None
2026-03-29 10:43:10 [auto1.de] INFO: Scrape type for UB65858: 0
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: FU68975
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU68975%27 HTTP/1.1" 200 None
2026-03-29 10:43:10 [auto1.de] INFO: Scrape type for FU68975: 0
2026-03-29 10:43:10 [auto1.de] INFO: Found listing with ID: KU93910
2026-03-29 10:43:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:43:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:43:41 [auto1.de] INFO: Channel: 24h | Page: 114 | totalHits: 6726 | hits on page: 40
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: BK24126
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: EC39473
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: ZK53162
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK53162%27 HTTP/1.1" 200 None
2026-03-29 10:43:41 [auto1.de] INFO: Scrape type for ZK53162: 0
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: EJ80176
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ80176%27 HTTP/1.1" 200 None
2026-03-29 10:43:41 [auto1.de] INFO: Scrape type for EJ80176: 0
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: YK25344
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: VL77051
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL77051%27 HTTP/1.1" 200 None
2026-03-29 10:43:41 [auto1.de] INFO: Scrape type for VL77051: 0
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: AN36712
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN36712%27 HTTP/1.1" 200 None
2026-03-29 10:43:41 [auto1.de] INFO: Scrape type for AN36712: 0
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: UG59761
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: YR07443
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: SW09087
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW09087%27 HTTP/1.1" 200 None
2026-03-29 10:43:41 [auto1.de] INFO: Scrape type for SW09087: 0
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: KX34445
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX34445%27 HTTP/1.1" 200 None
2026-03-29 10:43:41 [auto1.de] INFO: Scrape type for KX34445: 0
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: ND18169
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: FT81385
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT81385%27 HTTP/1.1" 200 None
2026-03-29 10:43:41 [auto1.de] INFO: Scrape type for FT81385: 0
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: VL67140
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL67140%27 HTTP/1.1" 200 None
2026-03-29 10:43:41 [auto1.de] INFO: Scrape type for VL67140: 0
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: EE74949
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: AN93893
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: SE09507
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE09507%27 HTTP/1.1" 200 None
2026-03-29 10:43:41 [auto1.de] INFO: Scrape type for SE09507: 0
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: AM43166
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM43166%27 HTTP/1.1" 200 None
2026-03-29 10:43:41 [auto1.de] INFO: Scrape type for AM43166: 0
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: ZY93547
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY93547%27 HTTP/1.1" 200 None
2026-03-29 10:43:41 [auto1.de] INFO: Scrape type for ZY93547: 0
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: MU36572
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: XU92987
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: MX59150
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX59150%27 HTTP/1.1" 200 None
2026-03-29 10:43:41 [auto1.de] INFO: Scrape type for MX59150: 0
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: AP20693
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: BH54290
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH54290%27 HTTP/1.1" 200 None
2026-03-29 10:43:41 [auto1.de] INFO: Scrape type for BH54290: 0
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: YT56915
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: CP27370
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP27370%27 HTTP/1.1" 200 None
2026-03-29 10:43:41 [auto1.de] INFO: Scrape type for CP27370: 0
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: HZ93598
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ93598%27 HTTP/1.1" 200 None
2026-03-29 10:43:41 [auto1.de] INFO: Scrape type for HZ93598: 0
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: UK49641
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK49641%27 HTTP/1.1" 200 None
2026-03-29 10:43:41 [auto1.de] INFO: Scrape type for UK49641: 0
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: VX05177
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: ZK07522
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: DL82245
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL82245%27 HTTP/1.1" 200 None
2026-03-29 10:43:41 [auto1.de] INFO: Scrape type for DL82245: 0
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: WT01639
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT01639%27 HTTP/1.1" 200 None
2026-03-29 10:43:41 [auto1.de] INFO: Scrape type for WT01639: 0
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: UG67799
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG67799%27 HTTP/1.1" 200 None
2026-03-29 10:43:41 [auto1.de] INFO: Scrape type for UG67799: 0
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: WF94997
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF94997%27 HTTP/1.1" 200 None
2026-03-29 10:43:41 [auto1.de] INFO: Scrape type for WF94997: 0
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: JL91815
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: CW65482
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW65482%27 HTTP/1.1" 200 None
2026-03-29 10:43:41 [auto1.de] INFO: Scrape type for CW65482: 0
2026-03-29 10:43:41 [auto1.de] INFO: Found listing with ID: US61717
2026-03-29 10:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US61717%27 HTTP/1.1" 200 None
2026-03-29 10:43:42 [auto1.de] INFO: Scrape type for US61717: 0
2026-03-29 10:43:42 [auto1.de] INFO: Found listing with ID: SG08144
2026-03-29 10:43:42 [auto1.de] INFO: Found listing with ID: MU16772
2026-03-29 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU16772%27 HTTP/1.1" 200 None
2026-03-29 10:43:42 [auto1.de] INFO: Scrape type for MU16772: 0
2026-03-29 10:43:42 [auto1.de] INFO: Found listing with ID: YF55621
2026-03-29 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF55621%27 HTTP/1.1" 200 None
2026-03-29 10:43:42 [auto1.de] INFO: Scrape type for YF55621: 0
2026-03-29 10:43:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:43:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:43:58 [auto1.de] INFO: Channel: 24h | Page: 115 | totalHits: 6726 | hits on page: 40
2026-03-29 10:43:58 [auto1.de] INFO: Found listing with ID: UJ63993
2026-03-29 10:43:58 [auto1.de] INFO: Found listing with ID: XP10598
2026-03-29 10:43:58 [auto1.de] INFO: Found listing with ID: JV63052
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV63052%27 HTTP/1.1" 200 None
2026-03-29 10:43:58 [auto1.de] INFO: Scrape type for JV63052: 0
2026-03-29 10:43:58 [auto1.de] INFO: Found listing with ID: UE48673
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE48673%27 HTTP/1.1" 200 None
2026-03-29 10:43:58 [auto1.de] INFO: Scrape type for UE48673: 0
2026-03-29 10:43:58 [auto1.de] INFO: Found listing with ID: PJ27093
2026-03-29 10:43:58 [auto1.de] INFO: Found listing with ID: WE87101
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE87101%27 HTTP/1.1" 200 None
2026-03-29 10:43:58 [auto1.de] INFO: Scrape type for WE87101: 0
2026-03-29 10:43:58 [auto1.de] INFO: Found listing with ID: FM49388
2026-03-29 10:43:58 [auto1.de] INFO: Found listing with ID: SG14649
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG14649%27 HTTP/1.1" 200 None
2026-03-29 10:43:58 [auto1.de] INFO: Scrape type for SG14649: 0
2026-03-29 10:43:58 [auto1.de] INFO: Found listing with ID: AM79611
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM79611%27 HTTP/1.1" 200 None
2026-03-29 10:43:58 [auto1.de] INFO: Scrape type for AM79611: 0
2026-03-29 10:43:58 [auto1.de] INFO: Found listing with ID: JE71066
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE71066%27 HTTP/1.1" 200 None
2026-03-29 10:43:58 [auto1.de] INFO: Scrape type for JE71066: 0
2026-03-29 10:43:58 [auto1.de] INFO: Found listing with ID: HW43883
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW43883%27 HTTP/1.1" 200 None
2026-03-29 10:43:58 [auto1.de] INFO: Scrape type for HW43883: 0
2026-03-29 10:43:58 [auto1.de] INFO: Found listing with ID: DV40482
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV40482%27 HTTP/1.1" 200 None
2026-03-29 10:43:58 [auto1.de] INFO: Scrape type for DV40482: 0
2026-03-29 10:43:58 [auto1.de] INFO: Found listing with ID: JX17185
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX17185%27 HTTP/1.1" 200 None
2026-03-29 10:43:58 [auto1.de] INFO: Scrape type for JX17185: 0
2026-03-29 10:43:58 [auto1.de] INFO: Found listing with ID: EK35927
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK35927%27 HTTP/1.1" 200 None
2026-03-29 10:43:58 [auto1.de] INFO: Scrape type for EK35927: 0
2026-03-29 10:43:58 [auto1.de] INFO: Found listing with ID: DA76775
2026-03-29 10:43:58 [auto1.de] INFO: Found listing with ID: HT48359
2026-03-29 10:43:58 [auto1.de] INFO: Found listing with ID: BH17233
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH17233%27 HTTP/1.1" 200 None
2026-03-29 10:43:58 [auto1.de] INFO: Scrape type for BH17233: 0
2026-03-29 10:43:58 [auto1.de] INFO: Found listing with ID: ZC42699
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC42699%27 HTTP/1.1" 200 None
2026-03-29 10:43:58 [auto1.de] INFO: Scrape type for ZC42699: 0
2026-03-29 10:43:58 [auto1.de] INFO: Found listing with ID: ET45765
2026-03-29 10:43:58 [auto1.de] INFO: Found listing with ID: TB42941
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB42941%27 HTTP/1.1" 200 None
2026-03-29 10:43:58 [auto1.de] INFO: Scrape type for TB42941: 0
2026-03-29 10:43:58 [auto1.de] INFO: Found listing with ID: HU37680
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU37680%27 HTTP/1.1" 200 None
2026-03-29 10:43:58 [auto1.de] INFO: Scrape type for HU37680: 0
2026-03-29 10:43:58 [auto1.de] INFO: Found listing with ID: DM49539
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM49539%27 HTTP/1.1" 200 None
2026-03-29 10:43:58 [auto1.de] INFO: Scrape type for DM49539: 0
2026-03-29 10:43:58 [auto1.de] INFO: Found listing with ID: RZ86023
2026-03-29 10:43:58 [auto1.de] INFO: Found listing with ID: ZU82600
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU82600%27 HTTP/1.1" 200 None
2026-03-29 10:43:58 [auto1.de] INFO: Scrape type for ZU82600: 2
2026-03-29 10:43:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38244341-64d9-58c5-9419-05167a0f6b75 with identifier: ZU82600
2026-03-29 10:43:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38244341-64d9-58c5-9419-05167a0f6b75 with scrape type 2
2026-03-29 10:43:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38244341-64d9-58c5-9419-05167a0f6b75 with scrape type 2
2026-03-29 10:43:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 38244341-64d9-58c5-9419-05167a0f6b75, identifier: ZU82600
2026-03-29 10:43:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 38244341-64d9-58c5-9419-05167a0f6b75 with identifier: ZU82600
2026-03-29 10:43:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 38244341-64d9-58c5-9419-05167a0f6b75 with identifier: ZU82600
2026-03-29 10:43:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 38244341-64d9-58c5-9419-05167a0f6b75 with identifier: ZU82600 to the API
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:43:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:01:14Z',
 'fuel_type': 'diesel',
 'id': '38244341-64d9-58c5-9419-05167a0f6b75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU82600',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 125778,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-06',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'GTD BlueMotion Tech',
 'year': 2014}
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU82600%27 HTTP/1.1" 200 None
2026-03-29 10:43:59 [auto1.de] INFO: Saving data for ZU82600: {'auction_closing_time': 1774882874.0, 'created_time': 1774034601.346195, 'last_price_update_time': 1774781039.598416}
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU82600') HTTP/1.1" 204 0
2026-03-29 10:43:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:43:59 [auto1.de] INFO: Found listing with ID: XG24427
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG24427%27 HTTP/1.1" 200 None
2026-03-29 10:43:59 [auto1.de] INFO: Scrape type for XG24427: 0
2026-03-29 10:43:59 [auto1.de] INFO: Found listing with ID: RX80532
2026-03-29 10:43:59 [auto1.de] INFO: Found listing with ID: AE19293
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE19293%27 HTTP/1.1" 200 None
2026-03-29 10:43:59 [auto1.de] INFO: Scrape type for AE19293: 0
2026-03-29 10:43:59 [auto1.de] INFO: Found listing with ID: NF75522
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF75522%27 HTTP/1.1" 200 None
2026-03-29 10:43:59 [auto1.de] INFO: Scrape type for NF75522: 0
2026-03-29 10:43:59 [auto1.de] INFO: Found listing with ID: VK80269
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK80269%27 HTTP/1.1" 200 None
2026-03-29 10:43:59 [auto1.de] INFO: Scrape type for VK80269: 0
2026-03-29 10:43:59 [auto1.de] INFO: Found listing with ID: SB35470
2026-03-29 10:43:59 [auto1.de] INFO: Found listing with ID: UF21072
2026-03-29 10:43:59 [auto1.de] INFO: Found listing with ID: XS48010
2026-03-29 10:43:59 [auto1.de] INFO: Found listing with ID: YD09657
2026-03-29 10:43:59 [auto1.de] INFO: Found listing with ID: VN06043
2026-03-29 10:43:59 [auto1.de] INFO: Found listing with ID: FD74109
2026-03-29 10:43:59 [auto1.de] INFO: Found listing with ID: CC98998
2026-03-29 10:43:59 [auto1.de] INFO: Found listing with ID: BP61239
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP61239%27 HTTP/1.1" 200 None
2026-03-29 10:43:59 [auto1.de] INFO: Scrape type for BP61239: 0
2026-03-29 10:43:59 [auto1.de] INFO: Found listing with ID: WY85656
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY85656%27 HTTP/1.1" 200 None
2026-03-29 10:43:59 [auto1.de] INFO: Scrape type for WY85656: 0
2026-03-29 10:43:59 [auto1.de] INFO: Found listing with ID: DS59487
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS59487%27 HTTP/1.1" 200 None
2026-03-29 10:43:59 [auto1.de] INFO: Scrape type for DS59487: 0
2026-03-29 10:43:59 [auto1.de] INFO: Found listing with ID: TK89149
2026-03-29 10:44:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:44:00 [auto1.de] INFO: Channel: 24h | Page: 116 | totalHits: 6726 | hits on page: 40
2026-03-29 10:44:00 [auto1.de] INFO: Found listing with ID: XK50877
2026-03-29 10:44:00 [auto1.de] INFO: Found listing with ID: TA61960
2026-03-29 10:44:00 [auto1.de] INFO: Found listing with ID: BZ01431
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ01431%27 HTTP/1.1" 200 None
2026-03-29 10:44:00 [auto1.de] INFO: Scrape type for BZ01431: 0
2026-03-29 10:44:00 [auto1.de] INFO: Found listing with ID: FV41920
2026-03-29 10:44:00 [auto1.de] INFO: Found listing with ID: HE00518
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE00518%27 HTTP/1.1" 200 None
2026-03-29 10:44:00 [auto1.de] INFO: Scrape type for HE00518: 0
2026-03-29 10:44:00 [auto1.de] INFO: Found listing with ID: LH51780
2026-03-29 10:44:00 [auto1.de] INFO: Found listing with ID: UX47002
2026-03-29 10:44:00 [auto1.de] INFO: Found listing with ID: XP96351
2026-03-29 10:44:00 [auto1.de] INFO: Found listing with ID: AV69297
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV69297%27 HTTP/1.1" 200 None
2026-03-29 10:44:00 [auto1.de] INFO: Scrape type for AV69297: 0
2026-03-29 10:44:00 [auto1.de] INFO: Found listing with ID: TM66386
2026-03-29 10:44:00 [auto1.de] INFO: Found listing with ID: MV92547
2026-03-29 10:44:00 [auto1.de] INFO: Found listing with ID: WP15063
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP15063%27 HTTP/1.1" 200 None
2026-03-29 10:44:00 [auto1.de] INFO: Scrape type for WP15063: 0
2026-03-29 10:44:00 [auto1.de] INFO: Found listing with ID: WL10604
2026-03-29 10:44:00 [auto1.de] INFO: Found listing with ID: LA57205
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA57205%27 HTTP/1.1" 200 None
2026-03-29 10:44:00 [auto1.de] INFO: Scrape type for LA57205: 0
2026-03-29 10:44:00 [auto1.de] INFO: Found listing with ID: JU77482
2026-03-29 10:44:00 [auto1.de] INFO: Found listing with ID: YP37345
2026-03-29 10:44:00 [auto1.de] INFO: Found listing with ID: YP93259
2026-03-29 10:44:00 [auto1.de] INFO: Found listing with ID: KR84974
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR84974%27 HTTP/1.1" 200 None
2026-03-29 10:44:00 [auto1.de] INFO: Scrape type for KR84974: 0
2026-03-29 10:44:00 [auto1.de] INFO: Found listing with ID: PX47030
2026-03-29 10:44:00 [auto1.de] INFO: Found listing with ID: KW72669
2026-03-29 10:44:00 [auto1.de] INFO: Found listing with ID: SZ10404
2026-03-29 10:44:00 [auto1.de] INFO: Found listing with ID: EB43981
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB43981%27 HTTP/1.1" 200 None
2026-03-29 10:44:00 [auto1.de] INFO: Scrape type for EB43981: 0
2026-03-29 10:44:00 [auto1.de] INFO: Found listing with ID: FM24732
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM24732%27 HTTP/1.1" 200 None
2026-03-29 10:44:00 [auto1.de] INFO: Scrape type for FM24732: 0
2026-03-29 10:44:00 [auto1.de] INFO: Found listing with ID: WE30814
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE30814%27 HTTP/1.1" 200 None
2026-03-29 10:44:00 [auto1.de] INFO: Scrape type for WE30814: 0
2026-03-29 10:44:00 [auto1.de] INFO: Found listing with ID: MS46414
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS46414%27 HTTP/1.1" 200 None
2026-03-29 10:44:00 [auto1.de] INFO: Scrape type for MS46414: 0
2026-03-29 10:44:00 [auto1.de] INFO: Found listing with ID: MP44977
2026-03-29 10:44:00 [auto1.de] INFO: Found listing with ID: DD09602
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD09602%27 HTTP/1.1" 200 None
2026-03-29 10:44:00 [auto1.de] INFO: Scrape type for DD09602: 0
2026-03-29 10:44:00 [auto1.de] INFO: Found listing with ID: AR33954
2026-03-29 10:44:00 [auto1.de] INFO: Found listing with ID: SB14031
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB14031%27 HTTP/1.1" 200 None
2026-03-29 10:44:00 [auto1.de] INFO: Scrape type for SB14031: 0
2026-03-29 10:44:00 [auto1.de] INFO: Found listing with ID: CE68759
2026-03-29 10:44:00 [auto1.de] INFO: Found listing with ID: RT09261
2026-03-29 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT09261%27 HTTP/1.1" 200 None
2026-03-29 10:44:01 [auto1.de] INFO: Scrape type for RT09261: 0
2026-03-29 10:44:01 [auto1.de] INFO: Found listing with ID: NC07171
2026-03-29 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC07171%27 HTTP/1.1" 200 None
2026-03-29 10:44:01 [auto1.de] INFO: Scrape type for NC07171: 0
2026-03-29 10:44:01 [auto1.de] INFO: Found listing with ID: LJ68235
2026-03-29 10:44:01 [auto1.de] INFO: Found listing with ID: AW26108
2026-03-29 10:44:01 [auto1.de] INFO: Found listing with ID: EE70879
2026-03-29 10:44:01 [auto1.de] INFO: Found listing with ID: XC86569
2026-03-29 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC86569%27 HTTP/1.1" 200 None
2026-03-29 10:44:01 [auto1.de] INFO: Scrape type for XC86569: 0
2026-03-29 10:44:01 [auto1.de] INFO: Found listing with ID: HW02228
2026-03-29 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW02228%27 HTTP/1.1" 200 None
2026-03-29 10:44:01 [auto1.de] INFO: Scrape type for HW02228: 0
2026-03-29 10:44:01 [auto1.de] INFO: Found listing with ID: ST04128
2026-03-29 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST04128%27 HTTP/1.1" 200 None
2026-03-29 10:44:01 [auto1.de] INFO: Scrape type for ST04128: 0
2026-03-29 10:44:01 [auto1.de] INFO: Found listing with ID: EC74122
2026-03-29 10:44:01 [auto1.de] INFO: Found listing with ID: EJ12041
2026-03-29 10:44:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:44:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:44:02 [auto1.de] INFO: Channel: 24h | Page: 117 | totalHits: 6726 | hits on page: 40
2026-03-29 10:44:02 [auto1.de] INFO: Found listing with ID: WM50806
2026-03-29 10:44:02 [auto1.de] INFO: Found listing with ID: KW68340
2026-03-29 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW68340%27 HTTP/1.1" 200 None
2026-03-29 10:44:02 [auto1.de] INFO: Scrape type for KW68340: 0
2026-03-29 10:44:02 [auto1.de] INFO: Found listing with ID: PD01129
2026-03-29 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD01129%27 HTTP/1.1" 200 None
2026-03-29 10:44:02 [auto1.de] INFO: Scrape type for PD01129: 0
2026-03-29 10:44:02 [auto1.de] INFO: Found listing with ID: WV19329
2026-03-29 10:44:02 [auto1.de] INFO: Found listing with ID: KX24569
2026-03-29 10:44:02 [auto1.de] INFO: Found listing with ID: KA83154
2026-03-29 10:44:02 [auto1.de] INFO: Found listing with ID: VR66334
2026-03-29 10:44:02 [auto1.de] INFO: Found listing with ID: WW55400
2026-03-29 10:44:02 [auto1.de] INFO: Found listing with ID: UB61823
2026-03-29 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB61823%27 HTTP/1.1" 200 None
2026-03-29 10:44:02 [auto1.de] INFO: Scrape type for UB61823: 0
2026-03-29 10:44:02 [auto1.de] INFO: Found listing with ID: JB86141
2026-03-29 10:44:02 [auto1.de] INFO: Found listing with ID: EU38402
2026-03-29 10:44:02 [auto1.de] INFO: Found listing with ID: NX41680
2026-03-29 10:44:02 [auto1.de] INFO: Found listing with ID: GR15033
2026-03-29 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR15033%27 HTTP/1.1" 200 None
2026-03-29 10:44:02 [auto1.de] INFO: Scrape type for GR15033: 2
2026-03-29 10:44:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc7345c6-e58d-57e4-9dfd-933afac4f56f with identifier: GR15033
2026-03-29 10:44:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc7345c6-e58d-57e4-9dfd-933afac4f56f with scrape type 2
2026-03-29 10:44:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc7345c6-e58d-57e4-9dfd-933afac4f56f with scrape type 2
2026-03-29 10:44:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc7345c6-e58d-57e4-9dfd-933afac4f56f, identifier: GR15033
2026-03-29 10:44:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc7345c6-e58d-57e4-9dfd-933afac4f56f with identifier: GR15033
2026-03-29 10:44:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc7345c6-e58d-57e4-9dfd-933afac4f56f with identifier: GR15033
2026-03-29 10:44:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc7345c6-e58d-57e4-9dfd-933afac4f56f with identifier: GR15033 to the API
2026-03-29 10:44:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:02:08Z',
 'fuel_type': 'petrol',
 'id': 'cc7345c6-e58d-57e4-9dfd-933afac4f56f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR15033',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 43423,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-29',
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 MPI Cool Plus',
 'transmission': 'manual',
 'trim': 'Cool Plus',
 'year': 2019}
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR15033%27 HTTP/1.1" 200 None
2026-03-29 10:44:03 [auto1.de] INFO: Saving data for GR15033: {'auction_closing_time': 1774882928.0, 'created_time': 1774031831.967567, 'last_price_update_time': 1774781043.26622}
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR15033') HTTP/1.1" 204 0
2026-03-29 10:44:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:44:03 [auto1.de] INFO: Found listing with ID: AX24898
2026-03-29 10:44:03 [auto1.de] INFO: Found listing with ID: DW69161
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW69161%27 HTTP/1.1" 200 None
2026-03-29 10:44:03 [auto1.de] INFO: Scrape type for DW69161: 0
2026-03-29 10:44:03 [auto1.de] INFO: Found listing with ID: GD44773
2026-03-29 10:44:03 [auto1.de] INFO: Found listing with ID: JK09354
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK09354%27 HTTP/1.1" 200 None
2026-03-29 10:44:03 [auto1.de] INFO: Scrape type for JK09354: 0
2026-03-29 10:44:03 [auto1.de] INFO: Found listing with ID: UE92744
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE92744%27 HTTP/1.1" 200 None
2026-03-29 10:44:03 [auto1.de] INFO: Scrape type for UE92744: 0
2026-03-29 10:44:03 [auto1.de] INFO: Found listing with ID: BX45513
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX45513%27 HTTP/1.1" 200 None
2026-03-29 10:44:03 [auto1.de] INFO: Scrape type for BX45513: 0
2026-03-29 10:44:03 [auto1.de] INFO: Found listing with ID: CV00012
2026-03-29 10:44:03 [auto1.de] INFO: Found listing with ID: VH92759
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH92759%27 HTTP/1.1" 200 None
2026-03-29 10:44:03 [auto1.de] INFO: Scrape type for VH92759: 0
2026-03-29 10:44:03 [auto1.de] INFO: Found listing with ID: UH05961
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH05961%27 HTTP/1.1" 200 None
2026-03-29 10:44:03 [auto1.de] INFO: Scrape type for UH05961: 0
2026-03-29 10:44:03 [auto1.de] INFO: Found listing with ID: SX50197
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX50197%27 HTTP/1.1" 200 None
2026-03-29 10:44:03 [auto1.de] INFO: Scrape type for SX50197: 0
2026-03-29 10:44:03 [auto1.de] INFO: Found listing with ID: WD76267
2026-03-29 10:44:03 [auto1.de] INFO: Found listing with ID: WF46634
2026-03-29 10:44:03 [auto1.de] INFO: Found listing with ID: MK74159
2026-03-29 10:44:03 [auto1.de] INFO: Found listing with ID: MB99639
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB99639%27 HTTP/1.1" 200 None
2026-03-29 10:44:03 [auto1.de] INFO: Scrape type for MB99639: 2
2026-03-29 10:44:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e48e594-4a99-577b-88b8-867a479ecbf9 with identifier: MB99639
2026-03-29 10:44:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e48e594-4a99-577b-88b8-867a479ecbf9 with scrape type 2
2026-03-29 10:44:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e48e594-4a99-577b-88b8-867a479ecbf9 with scrape type 2
2026-03-29 10:44:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e48e594-4a99-577b-88b8-867a479ecbf9, identifier: MB99639
2026-03-29 10:44:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e48e594-4a99-577b-88b8-867a479ecbf9 with identifier: MB99639
2026-03-29 10:44:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e48e594-4a99-577b-88b8-867a479ecbf9 with identifier: MB99639
2026-03-29 10:44:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e48e594-4a99-577b-88b8-867a479ecbf9 with identifier: MB99639 to the API
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:28:14Z',
 'fuel_type': 'petrol',
 'id': '8e48e594-4a99-577b-88b8-867a479ecbf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB99639',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 195836,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-07',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB99639%27 HTTP/1.1" 200 None
2026-03-29 10:44:03 [auto1.de] INFO: Saving data for MB99639: {'auction_closing_time': 1774884494.0, 'created_time': 1774350859.604669, 'last_price_update_time': 1774781043.982497}
2026-03-29 10:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MB99639') HTTP/1.1" 204 0
2026-03-29 10:44:04 [auto1.de] INFO: Found listing with ID: JY20186
2026-03-29 10:44:04 [auto1.de] INFO: Found listing with ID: XF93739
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF93739%27 HTTP/1.1" 200 None
2026-03-29 10:44:04 [auto1.de] INFO: Scrape type for XF93739: 0
2026-03-29 10:44:04 [auto1.de] INFO: Found listing with ID: MT56584
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT56584%27 HTTP/1.1" 200 None
2026-03-29 10:44:04 [auto1.de] INFO: Scrape type for MT56584: 0
2026-03-29 10:44:04 [auto1.de] INFO: Found listing with ID: BV96832
2026-03-29 10:44:04 [auto1.de] INFO: Found listing with ID: XJ30357
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ30357%27 HTTP/1.1" 200 None
2026-03-29 10:44:04 [auto1.de] INFO: Scrape type for XJ30357: 0
2026-03-29 10:44:04 [auto1.de] INFO: Found listing with ID: FA59135
2026-03-29 10:44:04 [auto1.de] INFO: Found listing with ID: FB48782
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB48782%27 HTTP/1.1" 200 None
2026-03-29 10:44:04 [auto1.de] INFO: Scrape type for FB48782: 0
2026-03-29 10:44:04 [auto1.de] INFO: Found listing with ID: YE81869
2026-03-29 10:44:04 [auto1.de] INFO: Found listing with ID: JG82377
2026-03-29 10:44:04 [auto1.de] INFO: Found listing with ID: JY20975
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY20975%27 HTTP/1.1" 200 None
2026-03-29 10:44:04 [auto1.de] INFO: Scrape type for JY20975: 0
2026-03-29 10:44:04 [auto1.de] INFO: Found listing with ID: GJ77265
2026-03-29 10:44:04 [auto1.de] INFO: Found listing with ID: VA13792
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA13792%27 HTTP/1.1" 200 None
2026-03-29 10:44:04 [auto1.de] INFO: Scrape type for VA13792: 2
2026-03-29 10:44:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41b82ed4-8cba-5fa6-a37a-0d700f148967 with identifier: VA13792
2026-03-29 10:44:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41b82ed4-8cba-5fa6-a37a-0d700f148967 with scrape type 2
2026-03-29 10:44:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41b82ed4-8cba-5fa6-a37a-0d700f148967 with scrape type 2
2026-03-29 10:44:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41b82ed4-8cba-5fa6-a37a-0d700f148967, identifier: VA13792
2026-03-29 10:44:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41b82ed4-8cba-5fa6-a37a-0d700f148967 with identifier: VA13792
2026-03-29 10:44:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41b82ed4-8cba-5fa6-a37a-0d700f148967 with identifier: VA13792
2026-03-29 10:44:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41b82ed4-8cba-5fa6-a37a-0d700f148967 with identifier: VA13792 to the API
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 280,
 'expiration_date': '2026-03-30T15:35:20Z',
 'fuel_type': 'petrol',
 'id': '41b82ed4-8cba-5fa6-a37a-0d700f148967',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA13792',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 14905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-23',
 'seller_name': None,
 'title': 'Ford Focus 2.3 EcoBoost ST X',
 'transmission': 'automatic',
 'trim': 'ST X',
 'year': 2023}
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA13792%27 HTTP/1.1" 200 None
2026-03-29 10:44:04 [auto1.de] INFO: Saving data for VA13792: {'auction_closing_time': 1774884920.0, 'created_time': 1773686290.298045, 'last_price_update_time': 1774781044.803801}
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VA13792') HTTP/1.1" 204 0
2026-03-29 10:44:04 [auto1.de] INFO: Found listing with ID: CM58161
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM58161%27 HTTP/1.1" 200 None
2026-03-29 10:44:04 [auto1.de] INFO: Scrape type for CM58161: 0
2026-03-29 10:44:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:44:05 [auto1.de] INFO: Channel: 24h | Page: 118 | totalHits: 6726 | hits on page: 40
2026-03-29 10:44:05 [auto1.de] INFO: Found listing with ID: SP67485
2026-03-29 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP67485%27 HTTP/1.1" 200 None
2026-03-29 10:44:05 [auto1.de] INFO: Scrape type for SP67485: 0
2026-03-29 10:44:05 [auto1.de] INFO: Found listing with ID: BY18365
2026-03-29 10:44:05 [auto1.de] INFO: Found listing with ID: FX80624
2026-03-29 10:44:05 [auto1.de] INFO: Found listing with ID: PS45422
2026-03-29 10:44:05 [auto1.de] INFO: Found listing with ID: BC52904
2026-03-29 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC52904%27 HTTP/1.1" 200 None
2026-03-29 10:44:05 [auto1.de] INFO: Scrape type for BC52904: 0
2026-03-29 10:44:05 [auto1.de] INFO: Found listing with ID: GX75432
2026-03-29 10:44:05 [auto1.de] INFO: Found listing with ID: YA96721
2026-03-29 10:44:05 [auto1.de] INFO: Found listing with ID: JU59461
2026-03-29 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU59461%27 HTTP/1.1" 200 None
2026-03-29 10:44:05 [auto1.de] INFO: Scrape type for JU59461: 0
2026-03-29 10:44:05 [auto1.de] INFO: Found listing with ID: TU33144
2026-03-29 10:44:05 [auto1.de] INFO: Found listing with ID: GM45973
2026-03-29 10:44:05 [auto1.de] INFO: Found listing with ID: HX55522
2026-03-29 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX55522%27 HTTP/1.1" 200 None
2026-03-29 10:44:05 [auto1.de] INFO: Scrape type for HX55522: 0
2026-03-29 10:44:05 [auto1.de] INFO: Found listing with ID: EJ52813
2026-03-29 10:44:05 [auto1.de] INFO: Found listing with ID: WC63279
2026-03-29 10:44:05 [auto1.de] INFO: Found listing with ID: YC54043
2026-03-29 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC54043%27 HTTP/1.1" 200 None
2026-03-29 10:44:05 [auto1.de] INFO: Scrape type for YC54043: 0
2026-03-29 10:44:05 [auto1.de] INFO: Found listing with ID: CE80644
2026-03-29 10:44:05 [auto1.de] INFO: Found listing with ID: BX52940
2026-03-29 10:44:05 [auto1.de] INFO: Found listing with ID: YF47459
2026-03-29 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF47459%27 HTTP/1.1" 200 None
2026-03-29 10:44:05 [auto1.de] INFO: Scrape type for YF47459: 0
2026-03-29 10:44:05 [auto1.de] INFO: Found listing with ID: SX52884
2026-03-29 10:44:05 [auto1.de] INFO: Found listing with ID: TS98939
2026-03-29 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS98939%27 HTTP/1.1" 200 None
2026-03-29 10:44:05 [auto1.de] INFO: Scrape type for TS98939: 0
2026-03-29 10:44:05 [auto1.de] INFO: Found listing with ID: RV05301
2026-03-29 10:44:05 [auto1.de] INFO: Found listing with ID: NV91199
2026-03-29 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV91199%27 HTTP/1.1" 200 None
2026-03-29 10:44:05 [auto1.de] INFO: Scrape type for NV91199: 0
2026-03-29 10:44:05 [auto1.de] INFO: Found listing with ID: YY76457
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY76457%27 HTTP/1.1" 200 None
2026-03-29 10:44:06 [auto1.de] INFO: Scrape type for YY76457: 0
2026-03-29 10:44:06 [auto1.de] INFO: Found listing with ID: HH54610
2026-03-29 10:44:06 [auto1.de] INFO: Found listing with ID: RZ49473
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ49473%27 HTTP/1.1" 200 None
2026-03-29 10:44:06 [auto1.de] INFO: Scrape type for RZ49473: 0
2026-03-29 10:44:06 [auto1.de] INFO: Found listing with ID: BL02906
2026-03-29 10:44:06 [auto1.de] INFO: Found listing with ID: JM16548
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM16548%27 HTTP/1.1" 200 None
2026-03-29 10:44:06 [auto1.de] INFO: Scrape type for JM16548: 0
2026-03-29 10:44:06 [auto1.de] INFO: Found listing with ID: WW79477
2026-03-29 10:44:06 [auto1.de] INFO: Found listing with ID: MU06358
2026-03-29 10:44:06 [auto1.de] INFO: Found listing with ID: GE87881
2026-03-29 10:44:06 [auto1.de] INFO: Found listing with ID: ZY60733
2026-03-29 10:44:06 [auto1.de] INFO: Found listing with ID: SZ94185
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ94185%27 HTTP/1.1" 200 None
2026-03-29 10:44:06 [auto1.de] INFO: Scrape type for SZ94185: 2
2026-03-29 10:44:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0c33989-853a-5f5f-adfc-109e77f7342a with identifier: SZ94185
2026-03-29 10:44:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0c33989-853a-5f5f-adfc-109e77f7342a with scrape type 2
2026-03-29 10:44:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0c33989-853a-5f5f-adfc-109e77f7342a with scrape type 2
2026-03-29 10:44:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0c33989-853a-5f5f-adfc-109e77f7342a, identifier: SZ94185
2026-03-29 10:44:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0c33989-853a-5f5f-adfc-109e77f7342a with identifier: SZ94185
2026-03-29 10:44:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0c33989-853a-5f5f-adfc-109e77f7342a with identifier: SZ94185
2026-03-29 10:44:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0c33989-853a-5f5f-adfc-109e77f7342a with identifier: SZ94185 to the API
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:31:23Z',
 'fuel_type': 'diesel',
 'id': 'a0c33989-853a-5f5f-adfc-109e77f7342a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ94185',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 156954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-16',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTD BlueMotion',
 'year': 2019}
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ94185%27 HTTP/1.1" 200 None
2026-03-29 10:44:06 [auto1.de] INFO: Saving data for SZ94185: {'auction_closing_time': 1774884683.0, 'created_time': 1773304983.267014, 'last_price_update_time': 1774781046.586539}
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ94185') HTTP/1.1" 204 0
2026-03-29 10:44:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:44:06 [auto1.de] INFO: Found listing with ID: GK32978
2026-03-29 10:44:06 [auto1.de] INFO: Found listing with ID: EA80690
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA80690%27 HTTP/1.1" 200 None
2026-03-29 10:44:06 [auto1.de] INFO: Scrape type for EA80690: 0
2026-03-29 10:44:06 [auto1.de] INFO: Found listing with ID: WN68055
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN68055%27 HTTP/1.1" 200 None
2026-03-29 10:44:06 [auto1.de] INFO: Scrape type for WN68055: 0
2026-03-29 10:44:06 [auto1.de] INFO: Found listing with ID: HE65946
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE65946%27 HTTP/1.1" 200 None
2026-03-29 10:44:06 [auto1.de] INFO: Scrape type for HE65946: 0
2026-03-29 10:44:06 [auto1.de] INFO: Found listing with ID: GH74073
2026-03-29 10:44:06 [auto1.de] INFO: Found listing with ID: LC93569
2026-03-29 10:44:06 [auto1.de] INFO: Found listing with ID: XJ84301
2026-03-29 10:44:06 [auto1.de] INFO: Found listing with ID: ZW60338
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW60338%27 HTTP/1.1" 200 None
2026-03-29 10:44:06 [auto1.de] INFO: Scrape type for ZW60338: 0
2026-03-29 10:44:06 [auto1.de] INFO: Found listing with ID: PX99081
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX99081%27 HTTP/1.1" 200 None
2026-03-29 10:44:06 [auto1.de] INFO: Scrape type for PX99081: 0
2026-03-29 10:44:06 [scrapy.extensions.logstats] INFO: Crawled 180 pages (at 6 pages/min), scraped 257 items (at 5 items/min)
2026-03-29 10:44:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 160MiB
2026-03-29 10:44:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:44:07 [auto1.de] INFO: Channel: 24h | Page: 119 | totalHits: 6726 | hits on page: 40
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: GC49390
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: MX11435
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX11435%27 HTTP/1.1" 200 None
2026-03-29 10:44:07 [auto1.de] INFO: Scrape type for MX11435: 0
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: YJ21289
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ21289%27 HTTP/1.1" 200 None
2026-03-29 10:44:07 [auto1.de] INFO: Scrape type for YJ21289: 0
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: VW88901
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: DK10933
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: EN65963
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN65963%27 HTTP/1.1" 200 None
2026-03-29 10:44:07 [auto1.de] INFO: Scrape type for EN65963: 0
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: ZY38898
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: GY78752
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY78752%27 HTTP/1.1" 200 None
2026-03-29 10:44:07 [auto1.de] INFO: Scrape type for GY78752: 0
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: VU36237
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU36237%27 HTTP/1.1" 200 None
2026-03-29 10:44:07 [auto1.de] INFO: Scrape type for VU36237: 0
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: UW42720
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: WF79557
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: JS34798
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: HL77152
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL77152%27 HTTP/1.1" 200 None
2026-03-29 10:44:07 [auto1.de] INFO: Scrape type for HL77152: 0
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: UZ43781
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ43781%27 HTTP/1.1" 200 None
2026-03-29 10:44:07 [auto1.de] INFO: Scrape type for UZ43781: 0
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: TT07076
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: JF87432
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF87432%27 HTTP/1.1" 200 None
2026-03-29 10:44:07 [auto1.de] INFO: Scrape type for JF87432: 0
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: UU98141
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU98141%27 HTTP/1.1" 200 None
2026-03-29 10:44:07 [auto1.de] INFO: Scrape type for UU98141: 0
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: DY76053
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY76053%27 HTTP/1.1" 200 None
2026-03-29 10:44:07 [auto1.de] INFO: Scrape type for DY76053: 0
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: TX40728
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX40728%27 HTTP/1.1" 200 None
2026-03-29 10:44:07 [auto1.de] INFO: Scrape type for TX40728: 0
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: CA65369
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: US56502
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: SD28198
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: MX86281
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: NV48270
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: MN47186
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN47186%27 HTTP/1.1" 200 None
2026-03-29 10:44:07 [auto1.de] INFO: Scrape type for MN47186: 0
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: UJ83217
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: HW30650
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: EB09552
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB09552%27 HTTP/1.1" 200 None
2026-03-29 10:44:07 [auto1.de] INFO: Scrape type for EB09552: 0
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: GJ36407
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: RC78323
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC78323%27 HTTP/1.1" 200 None
2026-03-29 10:44:07 [auto1.de] INFO: Scrape type for RC78323: 0
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: ME64315
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: WX41369
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: LF76340
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF76340%27 HTTP/1.1" 200 None
2026-03-29 10:44:07 [auto1.de] INFO: Scrape type for LF76340: 0
2026-03-29 10:44:07 [auto1.de] INFO: Found listing with ID: JL50388
2026-03-29 10:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL50388%27 HTTP/1.1" 200 None
2026-03-29 10:44:08 [auto1.de] INFO: Scrape type for JL50388: 0
2026-03-29 10:44:08 [auto1.de] INFO: Found listing with ID: YF72599
2026-03-29 10:44:08 [auto1.de] INFO: Found listing with ID: AY49158
2026-03-29 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY49158%27 HTTP/1.1" 200 None
2026-03-29 10:44:08 [auto1.de] INFO: Scrape type for AY49158: 0
2026-03-29 10:44:08 [auto1.de] INFO: Found listing with ID: RC64301
2026-03-29 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC64301%27 HTTP/1.1" 200 None
2026-03-29 10:44:08 [auto1.de] INFO: Scrape type for RC64301: 0
2026-03-29 10:44:08 [auto1.de] INFO: Found listing with ID: PS95073
2026-03-29 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS95073%27 HTTP/1.1" 200 None
2026-03-29 10:44:08 [auto1.de] INFO: Scrape type for PS95073: 0
2026-03-29 10:44:08 [auto1.de] INFO: Found listing with ID: DK89074
2026-03-29 10:44:08 [auto1.de] INFO: Found listing with ID: ZA79718
2026-03-29 10:44:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:44:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:44:09 [auto1.de] INFO: Channel: 24h | Page: 120 | totalHits: 6726 | hits on page: 40
2026-03-29 10:44:09 [auto1.de] INFO: Found listing with ID: KV18846
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV18846%27 HTTP/1.1" 200 None
2026-03-29 10:44:09 [auto1.de] INFO: Scrape type for KV18846: 0
2026-03-29 10:44:09 [auto1.de] INFO: Found listing with ID: WW95477
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW95477%27 HTTP/1.1" 200 None
2026-03-29 10:44:09 [auto1.de] INFO: Scrape type for WW95477: 0
2026-03-29 10:44:09 [auto1.de] INFO: Found listing with ID: ZA60248
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA60248%27 HTTP/1.1" 200 None
2026-03-29 10:44:09 [auto1.de] INFO: Scrape type for ZA60248: 0
2026-03-29 10:44:09 [auto1.de] INFO: Found listing with ID: SX72009
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX72009%27 HTTP/1.1" 200 None
2026-03-29 10:44:09 [auto1.de] INFO: Scrape type for SX72009: 0
2026-03-29 10:44:09 [auto1.de] INFO: Found listing with ID: YT47398
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT47398%27 HTTP/1.1" 200 None
2026-03-29 10:44:09 [auto1.de] INFO: Scrape type for YT47398: 0
2026-03-29 10:44:09 [auto1.de] INFO: Found listing with ID: MN48285
2026-03-29 10:44:09 [auto1.de] INFO: Found listing with ID: SY50059
2026-03-29 10:44:09 [auto1.de] INFO: Found listing with ID: FF62684
2026-03-29 10:44:09 [auto1.de] INFO: Found listing with ID: VG18386
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG18386%27 HTTP/1.1" 200 None
2026-03-29 10:44:09 [auto1.de] INFO: Scrape type for VG18386: 0
2026-03-29 10:44:09 [auto1.de] INFO: Found listing with ID: PP24406
2026-03-29 10:44:09 [auto1.de] INFO: Found listing with ID: MZ72093
2026-03-29 10:44:09 [auto1.de] INFO: Found listing with ID: FM50450
2026-03-29 10:44:09 [auto1.de] INFO: Found listing with ID: BB52240
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB52240%27 HTTP/1.1" 200 None
2026-03-29 10:44:09 [auto1.de] INFO: Scrape type for BB52240: 0
2026-03-29 10:44:09 [auto1.de] INFO: Found listing with ID: TB77095
2026-03-29 10:44:09 [auto1.de] INFO: Found listing with ID: RK52419
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK52419%27 HTTP/1.1" 200 None
2026-03-29 10:44:09 [auto1.de] INFO: Scrape type for RK52419: 0
2026-03-29 10:44:09 [auto1.de] INFO: Found listing with ID: YB40017
2026-03-29 10:44:09 [auto1.de] INFO: Found listing with ID: HD93241
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD93241%27 HTTP/1.1" 200 None
2026-03-29 10:44:09 [auto1.de] INFO: Scrape type for HD93241: 0
2026-03-29 10:44:09 [auto1.de] INFO: Found listing with ID: ZS15843
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS15843%27 HTTP/1.1" 200 None
2026-03-29 10:44:09 [auto1.de] INFO: Scrape type for ZS15843: 0
2026-03-29 10:44:09 [auto1.de] INFO: Found listing with ID: HL71363
2026-03-29 10:44:09 [auto1.de] INFO: Found listing with ID: DP80486
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP80486%27 HTTP/1.1" 200 None
2026-03-29 10:44:09 [auto1.de] INFO: Scrape type for DP80486: 0
2026-03-29 10:44:09 [auto1.de] INFO: Found listing with ID: YU21879
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU21879%27 HTTP/1.1" 200 None
2026-03-29 10:44:09 [auto1.de] INFO: Scrape type for YU21879: 0
2026-03-29 10:44:09 [auto1.de] INFO: Found listing with ID: FZ89308
2026-03-29 10:44:09 [auto1.de] INFO: Found listing with ID: US92808
2026-03-29 10:44:09 [auto1.de] INFO: Found listing with ID: WR57027
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR57027%27 HTTP/1.1" 200 None
2026-03-29 10:44:09 [auto1.de] INFO: Scrape type for WR57027: 2
2026-03-29 10:44:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0173d4a8-f869-5e9c-82e6-21afda6f2cfd with identifier: WR57027
2026-03-29 10:44:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0173d4a8-f869-5e9c-82e6-21afda6f2cfd with scrape type 2
2026-03-29 10:44:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0173d4a8-f869-5e9c-82e6-21afda6f2cfd with scrape type 2
2026-03-29 10:44:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0173d4a8-f869-5e9c-82e6-21afda6f2cfd, identifier: WR57027
2026-03-29 10:44:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0173d4a8-f869-5e9c-82e6-21afda6f2cfd with identifier: WR57027
2026-03-29 10:44:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0173d4a8-f869-5e9c-82e6-21afda6f2cfd with identifier: WR57027
2026-03-29 10:44:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0173d4a8-f869-5e9c-82e6-21afda6f2cfd with identifier: WR57027 to the API
2026-03-29 10:44:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:03:39Z',
 'fuel_type': 'petrol',
 'id': '0173d4a8-f869-5e9c-82e6-21afda6f2cfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR57027',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 123369,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-20',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 CGI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2009}
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR57027%27 HTTP/1.1" 200 None
2026-03-29 10:44:10 [auto1.de] INFO: Saving data for WR57027: {'auction_closing_time': 1774883019.0, 'created_time': 1772728240.762251, 'last_price_update_time': 1774781050.284493}
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WR57027') HTTP/1.1" 204 0
2026-03-29 10:44:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:44:10 [auto1.de] INFO: Found listing with ID: HL98851
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL98851%27 HTTP/1.1" 200 None
2026-03-29 10:44:10 [auto1.de] INFO: Scrape type for HL98851: 0
2026-03-29 10:44:10 [auto1.de] INFO: Found listing with ID: ZG82631
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG82631%27 HTTP/1.1" 200 None
2026-03-29 10:44:10 [auto1.de] INFO: Scrape type for ZG82631: 0
2026-03-29 10:44:10 [auto1.de] INFO: Found listing with ID: GT14298
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT14298%27 HTTP/1.1" 200 None
2026-03-29 10:44:10 [auto1.de] INFO: Scrape type for GT14298: 0
2026-03-29 10:44:10 [auto1.de] INFO: Found listing with ID: SG17640
2026-03-29 10:44:10 [auto1.de] INFO: Found listing with ID: JZ53783
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ53783%27 HTTP/1.1" 200 None
2026-03-29 10:44:10 [auto1.de] INFO: Scrape type for JZ53783: 0
2026-03-29 10:44:10 [auto1.de] INFO: Found listing with ID: KV33048
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV33048%27 HTTP/1.1" 200 None
2026-03-29 10:44:10 [auto1.de] INFO: Scrape type for KV33048: 0
2026-03-29 10:44:10 [auto1.de] INFO: Found listing with ID: WW27642
2026-03-29 10:44:10 [auto1.de] INFO: Found listing with ID: JC18235
2026-03-29 10:44:10 [auto1.de] INFO: Found listing with ID: JH55559
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH55559%27 HTTP/1.1" 200 None
2026-03-29 10:44:10 [auto1.de] INFO: Scrape type for JH55559: 0
2026-03-29 10:44:10 [auto1.de] INFO: Found listing with ID: SM51050
2026-03-29 10:44:10 [auto1.de] INFO: Found listing with ID: RS52276
2026-03-29 10:44:10 [auto1.de] INFO: Found listing with ID: EY51453
2026-03-29 10:44:10 [auto1.de] INFO: Found listing with ID: HP12091
2026-03-29 10:44:10 [auto1.de] INFO: Found listing with ID: JB80015
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB80015%27 HTTP/1.1" 200 None
2026-03-29 10:44:10 [auto1.de] INFO: Scrape type for JB80015: 0
2026-03-29 10:44:10 [auto1.de] INFO: Found listing with ID: CJ75518
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ75518%27 HTTP/1.1" 200 None
2026-03-29 10:44:10 [auto1.de] INFO: Scrape type for CJ75518: 0
2026-03-29 10:44:10 [auto1.de] INFO: Found listing with ID: RF75953
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF75953%27 HTTP/1.1" 200 None
2026-03-29 10:44:10 [auto1.de] INFO: Scrape type for RF75953: 0
2026-03-29 10:44:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:44:11 [auto1.de] INFO: Channel: 24h | Page: 121 | totalHits: 6726 | hits on page: 40
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: DV93424
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV93424%27 HTTP/1.1" 200 None
2026-03-29 10:44:11 [auto1.de] INFO: Scrape type for DV93424: 0
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: DR32988
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR32988%27 HTTP/1.1" 200 None
2026-03-29 10:44:11 [auto1.de] INFO: Scrape type for DR32988: 0
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: ZW18782
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW18782%27 HTTP/1.1" 200 None
2026-03-29 10:44:11 [auto1.de] INFO: Scrape type for ZW18782: 0
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: SJ02075
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: JX09791
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX09791%27 HTTP/1.1" 200 None
2026-03-29 10:44:11 [auto1.de] INFO: Scrape type for JX09791: 0
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: RH01499
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH01499%27 HTTP/1.1" 200 None
2026-03-29 10:44:11 [auto1.de] INFO: Scrape type for RH01499: 0
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: NT88605
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: HU68423
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU68423%27 HTTP/1.1" 200 None
2026-03-29 10:44:11 [auto1.de] INFO: Scrape type for HU68423: 0
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: KJ60236
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: JV37620
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: UE90964
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: CT22641
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT22641%27 HTTP/1.1" 200 None
2026-03-29 10:44:11 [auto1.de] INFO: Scrape type for CT22641: 0
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: UJ55086
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ55086%27 HTTP/1.1" 200 None
2026-03-29 10:44:11 [auto1.de] INFO: Scrape type for UJ55086: 0
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: JX92669
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX92669%27 HTTP/1.1" 200 None
2026-03-29 10:44:11 [auto1.de] INFO: Scrape type for JX92669: 0
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: VL46030
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL46030%27 HTTP/1.1" 200 None
2026-03-29 10:44:11 [auto1.de] INFO: Scrape type for VL46030: 0
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: FY09014
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY09014%27 HTTP/1.1" 200 None
2026-03-29 10:44:11 [auto1.de] INFO: Scrape type for FY09014: 0
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: AF99280
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF99280%27 HTTP/1.1" 200 None
2026-03-29 10:44:11 [auto1.de] INFO: Scrape type for AF99280: 0
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: JG45711
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: JU04620
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU04620%27 HTTP/1.1" 200 None
2026-03-29 10:44:11 [auto1.de] INFO: Scrape type for JU04620: 0
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: LH30739
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: WS48459
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: NY09817
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: DP54088
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: TL69510
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: GX96959
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX96959%27 HTTP/1.1" 200 None
2026-03-29 10:44:11 [auto1.de] INFO: Scrape type for GX96959: 0
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: NM81365
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM81365%27 HTTP/1.1" 200 None
2026-03-29 10:44:11 [auto1.de] INFO: Scrape type for NM81365: 0
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: NP49973
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP49973%27 HTTP/1.1" 200 None
2026-03-29 10:44:11 [auto1.de] INFO: Scrape type for NP49973: 0
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: XN32134
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: PC42452
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: EC38320
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: VK72696
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK72696%27 HTTP/1.1" 200 None
2026-03-29 10:44:11 [auto1.de] INFO: Scrape type for VK72696: 0
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: YH26863
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: PD95192
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD95192%27 HTTP/1.1" 200 None
2026-03-29 10:44:11 [auto1.de] INFO: Scrape type for PD95192: 0
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: BX11616
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX11616%27 HTTP/1.1" 200 None
2026-03-29 10:44:11 [auto1.de] INFO: Scrape type for BX11616: 0
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: FE82761
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE82761%27 HTTP/1.1" 200 None
2026-03-29 10:44:11 [auto1.de] INFO: Scrape type for FE82761: 0
2026-03-29 10:44:11 [auto1.de] INFO: Found listing with ID: SW40365
2026-03-29 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW40365%27 HTTP/1.1" 200 None
2026-03-29 10:44:12 [auto1.de] INFO: Scrape type for SW40365: 0
2026-03-29 10:44:12 [auto1.de] INFO: Found listing with ID: TA30893
2026-03-29 10:44:12 [auto1.de] INFO: Found listing with ID: KL73476
2026-03-29 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL73476%27 HTTP/1.1" 200 None
2026-03-29 10:44:12 [auto1.de] INFO: Scrape type for KL73476: 0
2026-03-29 10:44:12 [auto1.de] INFO: Found listing with ID: DH72575
2026-03-29 10:44:12 [auto1.de] INFO: Found listing with ID: NV84583
2026-03-29 10:44:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:44:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:44:21 [auto1.de] INFO: Channel: 24h | Page: 122 | totalHits: 6726 | hits on page: 40
2026-03-29 10:44:21 [auto1.de] INFO: Found listing with ID: ER69054
2026-03-29 10:44:21 [auto1.de] INFO: Found listing with ID: RP99262
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP99262%27 HTTP/1.1" 200 None
2026-03-29 10:44:21 [auto1.de] INFO: Scrape type for RP99262: 0
2026-03-29 10:44:21 [auto1.de] INFO: Found listing with ID: YW50653
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW50653%27 HTTP/1.1" 200 None
2026-03-29 10:44:21 [auto1.de] INFO: Scrape type for YW50653: 0
2026-03-29 10:44:21 [auto1.de] INFO: Found listing with ID: UP40831
2026-03-29 10:44:21 [auto1.de] INFO: Found listing with ID: UY98084
2026-03-29 10:44:21 [auto1.de] INFO: Found listing with ID: NE13487
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE13487%27 HTTP/1.1" 200 None
2026-03-29 10:44:21 [auto1.de] INFO: Scrape type for NE13487: 0
2026-03-29 10:44:21 [auto1.de] INFO: Found listing with ID: BR43966
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR43966%27 HTTP/1.1" 200 None
2026-03-29 10:44:21 [auto1.de] INFO: Scrape type for BR43966: 0
2026-03-29 10:44:21 [auto1.de] INFO: Found listing with ID: KZ47858
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ47858%27 HTTP/1.1" 200 None
2026-03-29 10:44:21 [auto1.de] INFO: Scrape type for KZ47858: 0
2026-03-29 10:44:21 [auto1.de] INFO: Found listing with ID: FX67630
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX67630%27 HTTP/1.1" 200 None
2026-03-29 10:44:21 [auto1.de] INFO: Scrape type for FX67630: 0
2026-03-29 10:44:21 [auto1.de] INFO: Found listing with ID: FY46967
2026-03-29 10:44:21 [auto1.de] INFO: Found listing with ID: MX01041
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX01041%27 HTTP/1.1" 200 None
2026-03-29 10:44:21 [auto1.de] INFO: Scrape type for MX01041: 0
2026-03-29 10:44:21 [auto1.de] INFO: Found listing with ID: LL59024
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL59024%27 HTTP/1.1" 200 None
2026-03-29 10:44:21 [auto1.de] INFO: Scrape type for LL59024: 0
2026-03-29 10:44:21 [auto1.de] INFO: Found listing with ID: JG77097
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG77097%27 HTTP/1.1" 200 None
2026-03-29 10:44:21 [auto1.de] INFO: Scrape type for JG77097: 0
2026-03-29 10:44:21 [auto1.de] INFO: Found listing with ID: YU15721
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU15721%27 HTTP/1.1" 200 None
2026-03-29 10:44:21 [auto1.de] INFO: Scrape type for YU15721: 0
2026-03-29 10:44:21 [auto1.de] INFO: Found listing with ID: WB38942
2026-03-29 10:44:21 [auto1.de] INFO: Found listing with ID: BC20634
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC20634%27 HTTP/1.1" 200 None
2026-03-29 10:44:21 [auto1.de] INFO: Scrape type for BC20634: 0
2026-03-29 10:44:21 [auto1.de] INFO: Found listing with ID: GZ29273
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ29273%27 HTTP/1.1" 200 None
2026-03-29 10:44:21 [auto1.de] INFO: Scrape type for GZ29273: 0
2026-03-29 10:44:21 [auto1.de] INFO: Found listing with ID: NL95797
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL95797%27 HTTP/1.1" 200 None
2026-03-29 10:44:21 [auto1.de] INFO: Scrape type for NL95797: 0
2026-03-29 10:44:21 [auto1.de] INFO: Found listing with ID: DE56554
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE56554%27 HTTP/1.1" 200 None
2026-03-29 10:44:21 [auto1.de] INFO: Scrape type for DE56554: 2
2026-03-29 10:44:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26ff99e6-3497-52e8-8aa9-b4f7550fca68 with identifier: DE56554
2026-03-29 10:44:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26ff99e6-3497-52e8-8aa9-b4f7550fca68 with scrape type 2
2026-03-29 10:44:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26ff99e6-3497-52e8-8aa9-b4f7550fca68 with scrape type 2
2026-03-29 10:44:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 26ff99e6-3497-52e8-8aa9-b4f7550fca68, identifier: DE56554
2026-03-29 10:44:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 26ff99e6-3497-52e8-8aa9-b4f7550fca68 with identifier: DE56554
2026-03-29 10:44:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 26ff99e6-3497-52e8-8aa9-b4f7550fca68 with identifier: DE56554
2026-03-29 10:44:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 26ff99e6-3497-52e8-8aa9-b4f7550fca68 with identifier: DE56554 to the API
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:44:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:44:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:30:56Z',
 'fuel_type': 'petrol',
 'id': '26ff99e6-3497-52e8-8aa9-b4f7550fca68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE56554',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'MX-5',
 'odometer': 38109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-22',
 'seller_name': None,
 'title': 'Mazda MX-5 1.8 Center-Line Roadster Coupe',
 'transmission': 'manual',
 'trim': 'Center-Line Roadster Coupe',
 'year': 2014}
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE56554%27 HTTP/1.1" 200 None
2026-03-29 10:44:22 [auto1.de] INFO: Saving data for DE56554: {'auction_closing_time': 1774884656.0, 'created_time': 1773303472.439749, 'last_price_update_time': 1774781062.042689}
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE56554') HTTP/1.1" 204 0
2026-03-29 10:44:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:44:22 [auto1.de] INFO: Found listing with ID: JL37437
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL37437%27 HTTP/1.1" 200 None
2026-03-29 10:44:22 [auto1.de] INFO: Scrape type for JL37437: 0
2026-03-29 10:44:22 [auto1.de] INFO: Found listing with ID: XS50752
2026-03-29 10:44:22 [auto1.de] INFO: Found listing with ID: TN04984
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN04984%27 HTTP/1.1" 200 None
2026-03-29 10:44:22 [auto1.de] INFO: Scrape type for TN04984: 0
2026-03-29 10:44:22 [auto1.de] INFO: Found listing with ID: FH05972
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH05972%27 HTTP/1.1" 200 None
2026-03-29 10:44:22 [auto1.de] INFO: Scrape type for FH05972: 0
2026-03-29 10:44:22 [auto1.de] INFO: Found listing with ID: LR98326
2026-03-29 10:44:22 [auto1.de] INFO: Found listing with ID: PL89727
2026-03-29 10:44:22 [auto1.de] INFO: Found listing with ID: WD34588
2026-03-29 10:44:22 [auto1.de] INFO: Found listing with ID: DU96107
2026-03-29 10:44:22 [auto1.de] INFO: Found listing with ID: RA28686
2026-03-29 10:44:22 [auto1.de] INFO: Found listing with ID: LG94407
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG94407%27 HTTP/1.1" 200 None
2026-03-29 10:44:22 [auto1.de] INFO: Scrape type for LG94407: 0
2026-03-29 10:44:22 [auto1.de] INFO: Found listing with ID: JN34556
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN34556%27 HTTP/1.1" 200 None
2026-03-29 10:44:22 [auto1.de] INFO: Scrape type for JN34556: 0
2026-03-29 10:44:22 [auto1.de] INFO: Found listing with ID: DW90276
2026-03-29 10:44:22 [auto1.de] INFO: Found listing with ID: UA17642
2026-03-29 10:44:22 [auto1.de] INFO: Found listing with ID: YM57013
2026-03-29 10:44:22 [auto1.de] INFO: Found listing with ID: TH04951
2026-03-29 10:44:22 [auto1.de] INFO: Found listing with ID: WR98876
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR98876%27 HTTP/1.1" 200 None
2026-03-29 10:44:22 [auto1.de] INFO: Scrape type for WR98876: 0
2026-03-29 10:44:22 [auto1.de] INFO: Found listing with ID: UB28690
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB28690%27 HTTP/1.1" 200 None
2026-03-29 10:44:22 [auto1.de] INFO: Scrape type for UB28690: 0
2026-03-29 10:44:22 [auto1.de] INFO: Found listing with ID: TF57163
2026-03-29 10:44:22 [auto1.de] INFO: Found listing with ID: GA13082
2026-03-29 10:44:22 [auto1.de] INFO: Found listing with ID: WF57615
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF57615%27 HTTP/1.1" 200 None
2026-03-29 10:44:22 [auto1.de] INFO: Scrape type for WF57615: 0
2026-03-29 10:44:22 [auto1.de] INFO: Found listing with ID: DR68072
2026-03-29 10:44:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:44:28 [auto1.de] INFO: Channel: 24h | Page: 123 | totalHits: 6726 | hits on page: 40
2026-03-29 10:44:28 [auto1.de] INFO: Found listing with ID: BF61357
2026-03-29 10:44:28 [auto1.de] INFO: Found listing with ID: LB03108
2026-03-29 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB03108%27 HTTP/1.1" 200 None
2026-03-29 10:44:28 [auto1.de] INFO: Scrape type for LB03108: 0
2026-03-29 10:44:28 [auto1.de] INFO: Found listing with ID: GL61912
2026-03-29 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL61912%27 HTTP/1.1" 200 None
2026-03-29 10:44:28 [auto1.de] INFO: Scrape type for GL61912: 0
2026-03-29 10:44:28 [auto1.de] INFO: Found listing with ID: PC78051
2026-03-29 10:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC78051%27 HTTP/1.1" 200 None
2026-03-29 10:44:29 [auto1.de] INFO: Scrape type for PC78051: 0
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: GX15527
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: MH34813
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: KG12536
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG12536%27 HTTP/1.1" 200 None
2026-03-29 10:44:29 [auto1.de] INFO: Scrape type for KG12536: 0
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: XY70185
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: BY51393
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY51393%27 HTTP/1.1" 200 None
2026-03-29 10:44:29 [auto1.de] INFO: Scrape type for BY51393: 0
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: KV18345
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV18345%27 HTTP/1.1" 200 None
2026-03-29 10:44:29 [auto1.de] INFO: Scrape type for KV18345: 0
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: MY99054
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: LP67164
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: ZF64276
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: EU36809
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU36809%27 HTTP/1.1" 200 None
2026-03-29 10:44:29 [auto1.de] INFO: Scrape type for EU36809: 0
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: LF81800
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF81800%27 HTTP/1.1" 200 None
2026-03-29 10:44:29 [auto1.de] INFO: Scrape type for LF81800: 0
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: VH67229
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: MF45027
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: LK89545
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK89545%27 HTTP/1.1" 200 None
2026-03-29 10:44:29 [auto1.de] INFO: Scrape type for LK89545: 0
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: BU39152
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: MZ37789
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ37789%27 HTTP/1.1" 200 None
2026-03-29 10:44:29 [auto1.de] INFO: Scrape type for MZ37789: 0
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: WT06361
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT06361%27 HTTP/1.1" 200 None
2026-03-29 10:44:29 [auto1.de] INFO: Scrape type for WT06361: 0
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: GA31653
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA31653%27 HTTP/1.1" 200 None
2026-03-29 10:44:29 [auto1.de] INFO: Scrape type for GA31653: 0
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: TY20606
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY20606%27 HTTP/1.1" 200 None
2026-03-29 10:44:29 [auto1.de] INFO: Scrape type for TY20606: 0
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: NE15652
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE15652%27 HTTP/1.1" 200 None
2026-03-29 10:44:29 [auto1.de] INFO: Scrape type for NE15652: 0
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: NV13181
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: VB50178
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB50178%27 HTTP/1.1" 200 None
2026-03-29 10:44:29 [auto1.de] INFO: Scrape type for VB50178: 0
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: NZ01572
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ01572%27 HTTP/1.1" 200 None
2026-03-29 10:44:29 [auto1.de] INFO: Scrape type for NZ01572: 0
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: NE19972
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE19972%27 HTTP/1.1" 200 None
2026-03-29 10:44:29 [auto1.de] INFO: Scrape type for NE19972: 0
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: CP50790
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP50790%27 HTTP/1.1" 200 None
2026-03-29 10:44:29 [auto1.de] INFO: Scrape type for CP50790: 0
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: WU91677
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU91677%27 HTTP/1.1" 200 None
2026-03-29 10:44:29 [auto1.de] INFO: Scrape type for WU91677: 0
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: NF91917
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: YF79248
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF79248%27 HTTP/1.1" 200 None
2026-03-29 10:44:29 [auto1.de] INFO: Scrape type for YF79248: 0
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: WS69855
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: BU76386
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: TB49418
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: TW80485
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: NK53054
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK53054%27 HTTP/1.1" 200 None
2026-03-29 10:44:29 [auto1.de] INFO: Scrape type for NK53054: 0
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: JD76793
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: SG14297
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG14297%27 HTTP/1.1" 200 None
2026-03-29 10:44:29 [auto1.de] INFO: Scrape type for SG14297: 0
2026-03-29 10:44:29 [auto1.de] INFO: Found listing with ID: TZ00942
2026-03-29 10:44:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:44:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:44:40 [auto1.de] INFO: Channel: 24h | Page: 124 | totalHits: 6726 | hits on page: 40
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: KT36384
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: TY10898
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: ZV64166
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: KG05559
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG05559%27 HTTP/1.1" 200 None
2026-03-29 10:44:40 [auto1.de] INFO: Scrape type for KG05559: 0
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: EP38579
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: XX81034
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX81034%27 HTTP/1.1" 200 None
2026-03-29 10:44:40 [auto1.de] INFO: Scrape type for XX81034: 0
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: GV33356
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV33356%27 HTTP/1.1" 200 None
2026-03-29 10:44:40 [auto1.de] INFO: Scrape type for GV33356: 0
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: MA12811
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA12811%27 HTTP/1.1" 200 None
2026-03-29 10:44:40 [auto1.de] INFO: Scrape type for MA12811: 0
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: ZJ64916
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: AE21884
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: FU12915
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: BU81814
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: WT92712
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: XY91338
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY91338%27 HTTP/1.1" 200 None
2026-03-29 10:44:40 [auto1.de] INFO: Scrape type for XY91338: 0
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: WJ73657
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: JU65331
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: HP00850
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: ZL30155
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: DK81331
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: BH43917
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH43917%27 HTTP/1.1" 200 None
2026-03-29 10:44:40 [auto1.de] INFO: Scrape type for BH43917: 0
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: ZG14891
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: SY47772
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY47772%27 HTTP/1.1" 200 None
2026-03-29 10:44:40 [auto1.de] INFO: Scrape type for SY47772: 0
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: KG98772
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG98772%27 HTTP/1.1" 200 None
2026-03-29 10:44:40 [auto1.de] INFO: Scrape type for KG98772: 0
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: GG89012
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: RZ09497
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: LF01905
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: TE97467
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE97467%27 HTTP/1.1" 200 None
2026-03-29 10:44:40 [auto1.de] INFO: Scrape type for TE97467: 0
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: VK49169
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK49169%27 HTTP/1.1" 200 None
2026-03-29 10:44:40 [auto1.de] INFO: Scrape type for VK49169: 0
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: UJ17280
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: EN92666
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN92666%27 HTTP/1.1" 200 None
2026-03-29 10:44:40 [auto1.de] INFO: Scrape type for EN92666: 0
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: TW44839
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: HX15626
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: YX12921
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: LK21356
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: RL20580
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: AX39550
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: CG53828
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: GK27432
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK27432%27 HTTP/1.1" 200 None
2026-03-29 10:44:40 [auto1.de] INFO: Scrape type for GK27432: 0
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: VK36740
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK36740%27 HTTP/1.1" 200 None
2026-03-29 10:44:40 [auto1.de] INFO: Scrape type for VK36740: 0
2026-03-29 10:44:40 [auto1.de] INFO: Found listing with ID: RF33157
2026-03-29 10:44:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:44:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:44:41 [auto1.de] INFO: Channel: 24h | Page: 125 | totalHits: 6726 | hits on page: 40
2026-03-29 10:44:41 [auto1.de] INFO: Found listing with ID: WL85831
2026-03-29 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL85831%27 HTTP/1.1" 200 None
2026-03-29 10:44:41 [auto1.de] INFO: Scrape type for WL85831: 0
2026-03-29 10:44:41 [auto1.de] INFO: Found listing with ID: LJ39551
2026-03-29 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ39551%27 HTTP/1.1" 200 None
2026-03-29 10:44:41 [auto1.de] INFO: Scrape type for LJ39551: 0
2026-03-29 10:44:41 [auto1.de] INFO: Found listing with ID: JT67031
2026-03-29 10:44:41 [auto1.de] INFO: Found listing with ID: MA51695
2026-03-29 10:44:41 [auto1.de] INFO: Found listing with ID: TX92076
2026-03-29 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX92076%27 HTTP/1.1" 200 None
2026-03-29 10:44:41 [auto1.de] INFO: Scrape type for TX92076: 0
2026-03-29 10:44:41 [auto1.de] INFO: Found listing with ID: FV21429
2026-03-29 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV21429%27 HTTP/1.1" 200 None
2026-03-29 10:44:41 [auto1.de] INFO: Scrape type for FV21429: 0
2026-03-29 10:44:41 [auto1.de] INFO: Found listing with ID: VL78522
2026-03-29 10:44:41 [auto1.de] INFO: Found listing with ID: CY33039
2026-03-29 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY33039%27 HTTP/1.1" 200 None
2026-03-29 10:44:41 [auto1.de] INFO: Scrape type for CY33039: 0
2026-03-29 10:44:41 [auto1.de] INFO: Found listing with ID: CR82363
2026-03-29 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR82363%27 HTTP/1.1" 200 None
2026-03-29 10:44:41 [auto1.de] INFO: Scrape type for CR82363: 0
2026-03-29 10:44:41 [auto1.de] INFO: Found listing with ID: FU90427
2026-03-29 10:44:41 [auto1.de] INFO: Found listing with ID: TH91647
2026-03-29 10:44:41 [auto1.de] INFO: Found listing with ID: SZ45535
2026-03-29 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ45535%27 HTTP/1.1" 200 None
2026-03-29 10:44:41 [auto1.de] INFO: Scrape type for SZ45535: 0
2026-03-29 10:44:41 [auto1.de] INFO: Found listing with ID: KL68094
2026-03-29 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL68094%27 HTTP/1.1" 200 None
2026-03-29 10:44:41 [auto1.de] INFO: Scrape type for KL68094: 0
2026-03-29 10:44:41 [auto1.de] INFO: Found listing with ID: KA00227
2026-03-29 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA00227%27 HTTP/1.1" 200 None
2026-03-29 10:44:41 [auto1.de] INFO: Scrape type for KA00227: 0
2026-03-29 10:44:41 [auto1.de] INFO: Found listing with ID: LJ75768
2026-03-29 10:44:41 [auto1.de] INFO: Found listing with ID: SJ79213
2026-03-29 10:44:41 [auto1.de] INFO: Found listing with ID: MH37188
2026-03-29 10:44:41 [auto1.de] INFO: Found listing with ID: DK31638
2026-03-29 10:44:41 [auto1.de] INFO: Found listing with ID: GM12066
2026-03-29 10:44:41 [auto1.de] INFO: Found listing with ID: BM31151
2026-03-29 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM31151%27 HTTP/1.1" 200 None
2026-03-29 10:44:41 [auto1.de] INFO: Scrape type for BM31151: 0
2026-03-29 10:44:41 [auto1.de] INFO: Found listing with ID: PM88586
2026-03-29 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM88586%27 HTTP/1.1" 200 None
2026-03-29 10:44:41 [auto1.de] INFO: Scrape type for PM88586: 0
2026-03-29 10:44:41 [auto1.de] INFO: Found listing with ID: PC91683
2026-03-29 10:44:41 [auto1.de] INFO: Found listing with ID: GG98787
2026-03-29 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG98787%27 HTTP/1.1" 200 None
2026-03-29 10:44:41 [auto1.de] INFO: Scrape type for GG98787: 0
2026-03-29 10:44:41 [auto1.de] INFO: Found listing with ID: XG51341
2026-03-29 10:44:41 [auto1.de] INFO: Found listing with ID: BS00370
2026-03-29 10:44:41 [auto1.de] INFO: Found listing with ID: GN50102
2026-03-29 10:44:41 [auto1.de] INFO: Found listing with ID: HD47083
2026-03-29 10:44:41 [auto1.de] INFO: Found listing with ID: BE24372
2026-03-29 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE24372%27 HTTP/1.1" 200 None
2026-03-29 10:44:42 [auto1.de] INFO: Scrape type for BE24372: 0
2026-03-29 10:44:42 [auto1.de] INFO: Found listing with ID: HX18202
2026-03-29 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX18202%27 HTTP/1.1" 200 None
2026-03-29 10:44:42 [auto1.de] INFO: Scrape type for HX18202: 0
2026-03-29 10:44:42 [auto1.de] INFO: Found listing with ID: ZN65231
2026-03-29 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN65231%27 HTTP/1.1" 200 None
2026-03-29 10:44:42 [auto1.de] INFO: Scrape type for ZN65231: 0
2026-03-29 10:44:42 [auto1.de] INFO: Found listing with ID: FK36654
2026-03-29 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK36654%27 HTTP/1.1" 200 None
2026-03-29 10:44:42 [auto1.de] INFO: Scrape type for FK36654: 0
2026-03-29 10:44:42 [auto1.de] INFO: Found listing with ID: XW56933
2026-03-29 10:44:42 [auto1.de] INFO: Found listing with ID: CT53994
2026-03-29 10:44:42 [auto1.de] INFO: Found listing with ID: FB58638
2026-03-29 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB58638%27 HTTP/1.1" 200 None
2026-03-29 10:44:42 [auto1.de] INFO: Scrape type for FB58638: 0
2026-03-29 10:44:42 [auto1.de] INFO: Found listing with ID: LV47567
2026-03-29 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV47567%27 HTTP/1.1" 200 None
2026-03-29 10:44:42 [auto1.de] INFO: Scrape type for LV47567: 0
2026-03-29 10:44:42 [auto1.de] INFO: Found listing with ID: TT67137
2026-03-29 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT67137%27 HTTP/1.1" 200 None
2026-03-29 10:44:42 [auto1.de] INFO: Scrape type for TT67137: 0
2026-03-29 10:44:42 [auto1.de] INFO: Found listing with ID: CD81555
2026-03-29 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD81555%27 HTTP/1.1" 200 None
2026-03-29 10:44:42 [auto1.de] INFO: Scrape type for CD81555: 0
2026-03-29 10:44:42 [auto1.de] INFO: Found listing with ID: FS32666
2026-03-29 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS32666%27 HTTP/1.1" 200 None
2026-03-29 10:44:42 [auto1.de] INFO: Scrape type for FS32666: 0
2026-03-29 10:44:42 [auto1.de] INFO: Found listing with ID: MA63217
2026-03-29 10:44:42 [auto1.de] INFO: Found listing with ID: FT28462
2026-03-29 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT28462%27 HTTP/1.1" 200 None
2026-03-29 10:44:42 [auto1.de] INFO: Scrape type for FT28462: 0
2026-03-29 10:44:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:44:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:44:43 [auto1.de] INFO: Channel: 24h | Page: 126 | totalHits: 6726 | hits on page: 40
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: YW34309
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW34309%27 HTTP/1.1" 200 None
2026-03-29 10:44:43 [auto1.de] INFO: Scrape type for YW34309: 0
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: UK53846
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK53846%27 HTTP/1.1" 200 None
2026-03-29 10:44:43 [auto1.de] INFO: Scrape type for UK53846: 0
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: UT49919
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT49919%27 HTTP/1.1" 200 None
2026-03-29 10:44:43 [auto1.de] INFO: Scrape type for UT49919: 0
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: UC14078
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC14078%27 HTTP/1.1" 200 None
2026-03-29 10:44:43 [auto1.de] INFO: Scrape type for UC14078: 0
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: LW05271
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: DE59201
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: BJ86438
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ86438%27 HTTP/1.1" 200 None
2026-03-29 10:44:43 [auto1.de] INFO: Scrape type for BJ86438: 0
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: WX24181
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX24181%27 HTTP/1.1" 200 None
2026-03-29 10:44:43 [auto1.de] INFO: Scrape type for WX24181: 0
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: XK18770
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: NP46589
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP46589%27 HTTP/1.1" 200 None
2026-03-29 10:44:43 [auto1.de] INFO: Scrape type for NP46589: 0
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: BM05172
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM05172%27 HTTP/1.1" 200 None
2026-03-29 10:44:43 [auto1.de] INFO: Scrape type for BM05172: 0
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: XP95900
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: RX21062
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: PJ50890
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ50890%27 HTTP/1.1" 200 None
2026-03-29 10:44:43 [auto1.de] INFO: Scrape type for PJ50890: 0
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: UD63369
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: ZY31624
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY31624%27 HTTP/1.1" 200 None
2026-03-29 10:44:43 [auto1.de] INFO: Scrape type for ZY31624: 0
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: ND25281
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: HZ16106
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: BV38151
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV38151%27 HTTP/1.1" 200 None
2026-03-29 10:44:43 [auto1.de] INFO: Scrape type for BV38151: 0
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: SD67792
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: LE21956
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: AU06987
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: SC73852
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: JZ77542
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ77542%27 HTTP/1.1" 200 None
2026-03-29 10:44:43 [auto1.de] INFO: Scrape type for JZ77542: 0
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: RC48761
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC48761%27 HTTP/1.1" 200 None
2026-03-29 10:44:43 [auto1.de] INFO: Scrape type for RC48761: 0
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: SL60481
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: SX98211
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: YU55800
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: VE41795
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: LX11356
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX11356%27 HTTP/1.1" 200 None
2026-03-29 10:44:43 [auto1.de] INFO: Scrape type for LX11356: 0
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: PV56207
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: NH92244
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: LD57431
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD57431%27 HTTP/1.1" 200 None
2026-03-29 10:44:43 [auto1.de] INFO: Scrape type for LD57431: 0
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: FN16508
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN16508%27 HTTP/1.1" 200 None
2026-03-29 10:44:43 [auto1.de] INFO: Scrape type for FN16508: 0
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: PB97430
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: YY43681
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: HX92939
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX92939%27 HTTP/1.1" 200 None
2026-03-29 10:44:43 [auto1.de] INFO: Scrape type for HX92939: 0
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: DW00961
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: MZ98399
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ98399%27 HTTP/1.1" 200 None
2026-03-29 10:44:43 [auto1.de] INFO: Scrape type for MZ98399: 0
2026-03-29 10:44:43 [auto1.de] INFO: Found listing with ID: MJ13308
2026-03-29 10:44:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:44:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:44:44 [auto1.de] INFO: Channel: 24h | Page: 127 | totalHits: 6726 | hits on page: 40
2026-03-29 10:44:44 [auto1.de] INFO: Found listing with ID: BD43064
2026-03-29 10:44:44 [auto1.de] INFO: Found listing with ID: AJ27375
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ27375%27 HTTP/1.1" 200 None
2026-03-29 10:44:44 [auto1.de] INFO: Scrape type for AJ27375: 0
2026-03-29 10:44:44 [auto1.de] INFO: Found listing with ID: YB62347
2026-03-29 10:44:44 [auto1.de] INFO: Found listing with ID: VS70073
2026-03-29 10:44:44 [auto1.de] INFO: Found listing with ID: MA53170
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA53170%27 HTTP/1.1" 200 None
2026-03-29 10:44:44 [auto1.de] INFO: Scrape type for MA53170: 0
2026-03-29 10:44:44 [auto1.de] INFO: Found listing with ID: MF48816
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF48816%27 HTTP/1.1" 200 None
2026-03-29 10:44:44 [auto1.de] INFO: Scrape type for MF48816: 0
2026-03-29 10:44:44 [auto1.de] INFO: Found listing with ID: AW92068
2026-03-29 10:44:44 [auto1.de] INFO: Found listing with ID: NE25486
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE25486%27 HTTP/1.1" 200 None
2026-03-29 10:44:44 [auto1.de] INFO: Scrape type for NE25486: 0
2026-03-29 10:44:44 [auto1.de] INFO: Found listing with ID: TB30393
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB30393%27 HTTP/1.1" 200 None
2026-03-29 10:44:44 [auto1.de] INFO: Scrape type for TB30393: 0
2026-03-29 10:44:44 [auto1.de] INFO: Found listing with ID: WP04220
2026-03-29 10:44:44 [auto1.de] INFO: Found listing with ID: EW17525
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW17525%27 HTTP/1.1" 200 None
2026-03-29 10:44:44 [auto1.de] INFO: Scrape type for EW17525: 0
2026-03-29 10:44:44 [auto1.de] INFO: Found listing with ID: FZ02715
2026-03-29 10:44:44 [auto1.de] INFO: Found listing with ID: CZ36938
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ36938%27 HTTP/1.1" 200 None
2026-03-29 10:44:44 [auto1.de] INFO: Scrape type for CZ36938: 0
2026-03-29 10:44:44 [auto1.de] INFO: Found listing with ID: UX30716
2026-03-29 10:44:44 [auto1.de] INFO: Found listing with ID: CD08059
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD08059%27 HTTP/1.1" 200 None
2026-03-29 10:44:44 [auto1.de] INFO: Scrape type for CD08059: 0
2026-03-29 10:44:44 [auto1.de] INFO: Found listing with ID: JL21750
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL21750%27 HTTP/1.1" 200 None
2026-03-29 10:44:44 [auto1.de] INFO: Scrape type for JL21750: 0
2026-03-29 10:44:44 [auto1.de] INFO: Found listing with ID: KY02769
2026-03-29 10:44:44 [auto1.de] INFO: Found listing with ID: ZJ20078
2026-03-29 10:44:44 [auto1.de] INFO: Found listing with ID: VC80296
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC80296%27 HTTP/1.1" 200 None
2026-03-29 10:44:44 [auto1.de] INFO: Scrape type for VC80296: 0
2026-03-29 10:44:44 [auto1.de] INFO: Found listing with ID: KY11260
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY11260%27 HTTP/1.1" 200 None
2026-03-29 10:44:44 [auto1.de] INFO: Scrape type for KY11260: 0
2026-03-29 10:44:44 [auto1.de] INFO: Found listing with ID: RK60330
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK60330%27 HTTP/1.1" 200 None
2026-03-29 10:44:44 [auto1.de] INFO: Scrape type for RK60330: 0
2026-03-29 10:44:44 [auto1.de] INFO: Found listing with ID: NK67833
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK67833%27 HTTP/1.1" 200 None
2026-03-29 10:44:44 [auto1.de] INFO: Scrape type for NK67833: 0
2026-03-29 10:44:44 [auto1.de] INFO: Found listing with ID: PW98263
2026-03-29 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW98263%27 HTTP/1.1" 200 None
2026-03-29 10:44:45 [auto1.de] INFO: Scrape type for PW98263: 0
2026-03-29 10:44:45 [auto1.de] INFO: Found listing with ID: PU90892
2026-03-29 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU90892%27 HTTP/1.1" 200 None
2026-03-29 10:44:45 [auto1.de] INFO: Scrape type for PU90892: 0
2026-03-29 10:44:45 [auto1.de] INFO: Found listing with ID: HU72855
2026-03-29 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU72855%27 HTTP/1.1" 200 None
2026-03-29 10:44:45 [auto1.de] INFO: Scrape type for HU72855: 0
2026-03-29 10:44:45 [auto1.de] INFO: Found listing with ID: WB37074
2026-03-29 10:44:45 [auto1.de] INFO: Found listing with ID: JF95451
2026-03-29 10:44:45 [auto1.de] INFO: Found listing with ID: WN12652
2026-03-29 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN12652%27 HTTP/1.1" 200 None
2026-03-29 10:44:45 [auto1.de] INFO: Scrape type for WN12652: 0
2026-03-29 10:44:45 [auto1.de] INFO: Found listing with ID: VF27254
2026-03-29 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF27254%27 HTTP/1.1" 200 None
2026-03-29 10:44:45 [auto1.de] INFO: Scrape type for VF27254: 0
2026-03-29 10:44:45 [auto1.de] INFO: Found listing with ID: PZ82865
2026-03-29 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ82865%27 HTTP/1.1" 200 None
2026-03-29 10:44:45 [auto1.de] INFO: Scrape type for PZ82865: 0
2026-03-29 10:44:45 [auto1.de] INFO: Found listing with ID: LT58589
2026-03-29 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT58589%27 HTTP/1.1" 200 None
2026-03-29 10:44:45 [auto1.de] INFO: Scrape type for LT58589: 0
2026-03-29 10:44:45 [auto1.de] INFO: Found listing with ID: DB26331
2026-03-29 10:44:45 [auto1.de] INFO: Found listing with ID: LK66468
2026-03-29 10:44:45 [auto1.de] INFO: Found listing with ID: TK27520
2026-03-29 10:44:45 [auto1.de] INFO: Found listing with ID: ZS04919
2026-03-29 10:44:45 [auto1.de] INFO: Found listing with ID: NH12576
2026-03-29 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH12576%27 HTTP/1.1" 200 None
2026-03-29 10:44:45 [auto1.de] INFO: Scrape type for NH12576: 0
2026-03-29 10:44:45 [auto1.de] INFO: Found listing with ID: VW20064
2026-03-29 10:44:45 [auto1.de] INFO: Found listing with ID: HY06483
2026-03-29 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY06483%27 HTTP/1.1" 200 None
2026-03-29 10:44:45 [auto1.de] INFO: Scrape type for HY06483: 0
2026-03-29 10:44:45 [auto1.de] INFO: Found listing with ID: JR60766
2026-03-29 10:44:45 [auto1.de] INFO: Found listing with ID: XA54655
2026-03-29 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA54655%27 HTTP/1.1" 200 None
2026-03-29 10:44:45 [auto1.de] INFO: Scrape type for XA54655: 0
2026-03-29 10:44:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:44:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:44:46 [auto1.de] INFO: Channel: 24h | Page: 128 | totalHits: 6726 | hits on page: 40
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: YV09971
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: PW95662
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: GZ43118
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ43118%27 HTTP/1.1" 200 None
2026-03-29 10:44:46 [auto1.de] INFO: Scrape type for GZ43118: 0
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: DZ38540
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ38540%27 HTTP/1.1" 200 None
2026-03-29 10:44:46 [auto1.de] INFO: Scrape type for DZ38540: 0
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: FV94610
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV94610%27 HTTP/1.1" 200 None
2026-03-29 10:44:46 [auto1.de] INFO: Scrape type for FV94610: 0
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: KF40481
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: BU32595
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU32595%27 HTTP/1.1" 200 None
2026-03-29 10:44:46 [auto1.de] INFO: Scrape type for BU32595: 0
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: PY30704
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY30704%27 HTTP/1.1" 200 None
2026-03-29 10:44:46 [auto1.de] INFO: Scrape type for PY30704: 0
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: EG14085
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: GH53408
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: NJ08644
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: XP52765
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: UM78498
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: WM97258
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: XR01056
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR01056%27 HTTP/1.1" 200 None
2026-03-29 10:44:46 [auto1.de] INFO: Scrape type for XR01056: 0
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: XY63966
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY63966%27 HTTP/1.1" 200 None
2026-03-29 10:44:46 [auto1.de] INFO: Scrape type for XY63966: 0
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: GY83216
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY83216%27 HTTP/1.1" 200 None
2026-03-29 10:44:46 [auto1.de] INFO: Scrape type for GY83216: 0
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: GH14315
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH14315%27 HTTP/1.1" 200 None
2026-03-29 10:44:46 [auto1.de] INFO: Scrape type for GH14315: 0
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: CM40362
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: RR95104
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: NM34350
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: CJ52783
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: XG36075
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: MJ16162
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ16162%27 HTTP/1.1" 200 None
2026-03-29 10:44:46 [auto1.de] INFO: Scrape type for MJ16162: 0
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: MX66491
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX66491%27 HTTP/1.1" 200 None
2026-03-29 10:44:46 [auto1.de] INFO: Scrape type for MX66491: 0
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: ZY67116
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY67116%27 HTTP/1.1" 200 None
2026-03-29 10:44:46 [auto1.de] INFO: Scrape type for ZY67116: 0
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: MM33465
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM33465%27 HTTP/1.1" 200 None
2026-03-29 10:44:46 [auto1.de] INFO: Scrape type for MM33465: 0
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: WY50003
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY50003%27 HTTP/1.1" 200 None
2026-03-29 10:44:46 [auto1.de] INFO: Scrape type for WY50003: 0
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: ZE17013
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE17013%27 HTTP/1.1" 200 None
2026-03-29 10:44:46 [auto1.de] INFO: Scrape type for ZE17013: 0
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: JK50656
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK50656%27 HTTP/1.1" 200 None
2026-03-29 10:44:46 [auto1.de] INFO: Scrape type for JK50656: 0
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: YT60499
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: YJ00075
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ00075%27 HTTP/1.1" 200 None
2026-03-29 10:44:46 [auto1.de] INFO: Scrape type for YJ00075: 0
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: VN69903
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN69903%27 HTTP/1.1" 200 None
2026-03-29 10:44:46 [auto1.de] INFO: Scrape type for VN69903: 0
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: XS25100
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS25100%27 HTTP/1.1" 200 None
2026-03-29 10:44:46 [auto1.de] INFO: Scrape type for XS25100: 0
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: ZB59934
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB59934%27 HTTP/1.1" 200 None
2026-03-29 10:44:46 [auto1.de] INFO: Scrape type for ZB59934: 0
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: ZU85888
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: DK81412
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: LN23623
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN23623%27 HTTP/1.1" 200 None
2026-03-29 10:44:46 [auto1.de] INFO: Scrape type for LN23623: 0
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: YS74184
2026-03-29 10:44:46 [auto1.de] INFO: Found listing with ID: MK32752
2026-03-29 10:44:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:45:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:45:03 [auto1.de] INFO: Channel: 24h | Page: 129 | totalHits: 6726 | hits on page: 40
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: SK08799
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: GT57416
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: NE31655
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE31655%27 HTTP/1.1" 200 None
2026-03-29 10:45:03 [auto1.de] INFO: Scrape type for NE31655: 0
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: PA97502
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: VS20151
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: EW02544
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW02544%27 HTTP/1.1" 200 None
2026-03-29 10:45:03 [auto1.de] INFO: Scrape type for EW02544: 0
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: NW02543
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW02543%27 HTTP/1.1" 200 None
2026-03-29 10:45:03 [auto1.de] INFO: Scrape type for NW02543: 0
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: JV68869
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68869%27 HTTP/1.1" 200 None
2026-03-29 10:45:03 [auto1.de] INFO: Scrape type for JV68869: 0
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: DX01361
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX01361%27 HTTP/1.1" 200 None
2026-03-29 10:45:03 [auto1.de] INFO: Scrape type for DX01361: 0
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: ST89847
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: CM27166
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM27166%27 HTTP/1.1" 200 None
2026-03-29 10:45:03 [auto1.de] INFO: Scrape type for CM27166: 0
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: XJ97474
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ97474%27 HTTP/1.1" 200 None
2026-03-29 10:45:03 [auto1.de] INFO: Scrape type for XJ97474: 0
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: JR87294
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: RX10948
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX10948%27 HTTP/1.1" 200 None
2026-03-29 10:45:03 [auto1.de] INFO: Scrape type for RX10948: 0
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: XN65057
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN65057%27 HTTP/1.1" 200 None
2026-03-29 10:45:03 [auto1.de] INFO: Scrape type for XN65057: 0
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: XV15906
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: FV46397
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: RB77182
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: ZL98433
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL98433%27 HTTP/1.1" 200 None
2026-03-29 10:45:03 [auto1.de] INFO: Scrape type for ZL98433: 0
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: YV35353
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV35353%27 HTTP/1.1" 200 None
2026-03-29 10:45:03 [auto1.de] INFO: Scrape type for YV35353: 0
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: PC35903
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC35903%27 HTTP/1.1" 200 None
2026-03-29 10:45:03 [auto1.de] INFO: Scrape type for PC35903: 0
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: LL60682
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: HA44433
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: KY06770
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY06770%27 HTTP/1.1" 200 None
2026-03-29 10:45:03 [auto1.de] INFO: Scrape type for KY06770: 0
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: XS93446
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS93446%27 HTTP/1.1" 200 None
2026-03-29 10:45:03 [auto1.de] INFO: Scrape type for XS93446: 0
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: VR25014
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR25014%27 HTTP/1.1" 200 None
2026-03-29 10:45:03 [auto1.de] INFO: Scrape type for VR25014: 0
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: CC89371
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: BX01003
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: AJ83009
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ83009%27 HTTP/1.1" 200 None
2026-03-29 10:45:03 [auto1.de] INFO: Scrape type for AJ83009: 0
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: GH20850
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH20850%27 HTTP/1.1" 200 None
2026-03-29 10:45:03 [auto1.de] INFO: Scrape type for GH20850: 0
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: JZ38471
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ38471%27 HTTP/1.1" 200 None
2026-03-29 10:45:03 [auto1.de] INFO: Scrape type for JZ38471: 0
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: LK17231
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: PB00515
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: JR17394
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR17394%27 HTTP/1.1" 200 None
2026-03-29 10:45:03 [auto1.de] INFO: Scrape type for JR17394: 0
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: EX67189
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: LL09257
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: SC92751
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: KS94316
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: ML83071
2026-03-29 10:45:03 [auto1.de] INFO: Found listing with ID: TP96640
2026-03-29 10:45:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:45:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:45:04 [auto1.de] INFO: Channel: 24h | Page: 130 | totalHits: 6726 | hits on page: 40
2026-03-29 10:45:04 [auto1.de] INFO: Found listing with ID: XS14457
2026-03-29 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS14457%27 HTTP/1.1" 200 None
2026-03-29 10:45:04 [auto1.de] INFO: Scrape type for XS14457: 0
2026-03-29 10:45:04 [auto1.de] INFO: Found listing with ID: EX44757
2026-03-29 10:45:04 [auto1.de] INFO: Found listing with ID: ZG28999
2026-03-29 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG28999%27 HTTP/1.1" 200 None
2026-03-29 10:45:04 [auto1.de] INFO: Scrape type for ZG28999: 0
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: YL63918
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: XR15758
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: GW15546
2026-03-29 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW15546%27 HTTP/1.1" 200 None
2026-03-29 10:45:05 [auto1.de] INFO: Scrape type for GW15546: 0
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: ND29954
2026-03-29 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND29954%27 HTTP/1.1" 200 None
2026-03-29 10:45:05 [auto1.de] INFO: Scrape type for ND29954: 0
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: US86443
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: BX36135
2026-03-29 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX36135%27 HTTP/1.1" 200 None
2026-03-29 10:45:05 [auto1.de] INFO: Scrape type for BX36135: 0
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: CG07330
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: WA46177
2026-03-29 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA46177%27 HTTP/1.1" 200 None
2026-03-29 10:45:05 [auto1.de] INFO: Scrape type for WA46177: 0
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: MF63690
2026-03-29 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF63690%27 HTTP/1.1" 200 None
2026-03-29 10:45:05 [auto1.de] INFO: Scrape type for MF63690: 0
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: HV40211
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: DP55195
2026-03-29 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP55195%27 HTTP/1.1" 200 None
2026-03-29 10:45:05 [auto1.de] INFO: Scrape type for DP55195: 0
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: DS08913
2026-03-29 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS08913%27 HTTP/1.1" 200 None
2026-03-29 10:45:05 [auto1.de] INFO: Scrape type for DS08913: 0
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: ZG52180
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: VS42918
2026-03-29 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS42918%27 HTTP/1.1" 200 None
2026-03-29 10:45:05 [auto1.de] INFO: Scrape type for VS42918: 0
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: DV65946
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: JY24308
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: FM97642
2026-03-29 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM97642%27 HTTP/1.1" 200 None
2026-03-29 10:45:05 [auto1.de] INFO: Scrape type for FM97642: 0
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: RJ15430
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: VJ26450
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: UD91634
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: ZP95286
2026-03-29 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP95286%27 HTTP/1.1" 200 None
2026-03-29 10:45:05 [auto1.de] INFO: Scrape type for ZP95286: 0
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: DN11419
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: WC38783
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: UL11229
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: NA89904
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: MF41479
2026-03-29 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF41479%27 HTTP/1.1" 200 None
2026-03-29 10:45:05 [auto1.de] INFO: Scrape type for MF41479: 0
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: KC37462
2026-03-29 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC37462%27 HTTP/1.1" 200 None
2026-03-29 10:45:05 [auto1.de] INFO: Scrape type for KC37462: 0
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: HF93741
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: KB62018
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: VN00313
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: XD31530
2026-03-29 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD31530%27 HTTP/1.1" 200 None
2026-03-29 10:45:05 [auto1.de] INFO: Scrape type for XD31530: 0
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: UC48235
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: GV24790
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: AG68555
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: PP43066
2026-03-29 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP43066%27 HTTP/1.1" 200 None
2026-03-29 10:45:05 [auto1.de] INFO: Scrape type for PP43066: 0
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: UE28952
2026-03-29 10:45:05 [auto1.de] INFO: Found listing with ID: JN13946
2026-03-29 10:45:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:45:06 [scrapy.extensions.logstats] INFO: Crawled 192 pages (at 12 pages/min), scraped 259 items (at 2 items/min)
2026-03-29 10:45:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 160MiB
2026-03-29 10:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:45:27 [auto1.de] INFO: Channel: 24h | Page: 131 | totalHits: 6726 | hits on page: 40
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: VJ90236
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ90236%27 HTTP/1.1" 200 None
2026-03-29 10:45:27 [auto1.de] INFO: Scrape type for VJ90236: 0
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: MS86460
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS86460%27 HTTP/1.1" 200 None
2026-03-29 10:45:27 [auto1.de] INFO: Scrape type for MS86460: 0
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: GZ31172
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ31172%27 HTTP/1.1" 200 None
2026-03-29 10:45:27 [auto1.de] INFO: Scrape type for GZ31172: 0
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: AE12757
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: GA58010
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: GU48092
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU48092%27 HTTP/1.1" 200 None
2026-03-29 10:45:27 [auto1.de] INFO: Scrape type for GU48092: 0
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: UT93934
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT93934%27 HTTP/1.1" 200 None
2026-03-29 10:45:27 [auto1.de] INFO: Scrape type for UT93934: 0
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: KD53590
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD53590%27 HTTP/1.1" 200 None
2026-03-29 10:45:27 [auto1.de] INFO: Scrape type for KD53590: 0
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: PZ27483
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: DJ97721
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: GN70453
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN70453%27 HTTP/1.1" 200 None
2026-03-29 10:45:27 [auto1.de] INFO: Scrape type for GN70453: 0
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: XD68871
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: ZE72511
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: WP84657
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP84657%27 HTTP/1.1" 200 None
2026-03-29 10:45:27 [auto1.de] INFO: Scrape type for WP84657: 0
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: WE09551
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE09551%27 HTTP/1.1" 200 None
2026-03-29 10:45:27 [auto1.de] INFO: Scrape type for WE09551: 0
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: VE41412
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: UZ82929
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ82929%27 HTTP/1.1" 200 None
2026-03-29 10:45:27 [auto1.de] INFO: Scrape type for UZ82929: 0
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: AU97195
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU97195%27 HTTP/1.1" 200 None
2026-03-29 10:45:27 [auto1.de] INFO: Scrape type for AU97195: 0
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: LL81874
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL81874%27 HTTP/1.1" 200 None
2026-03-29 10:45:27 [auto1.de] INFO: Scrape type for LL81874: 0
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: FH31570
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: EU98670
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU98670%27 HTTP/1.1" 200 None
2026-03-29 10:45:27 [auto1.de] INFO: Scrape type for EU98670: 0
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: MP71410
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: VH71903
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH71903%27 HTTP/1.1" 200 None
2026-03-29 10:45:27 [auto1.de] INFO: Scrape type for VH71903: 0
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: VH64157
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH64157%27 HTTP/1.1" 200 None
2026-03-29 10:45:27 [auto1.de] INFO: Scrape type for VH64157: 0
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: LG36185
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG36185%27 HTTP/1.1" 200 None
2026-03-29 10:45:27 [auto1.de] INFO: Scrape type for LG36185: 0
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: ZH41953
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH41953%27 HTTP/1.1" 200 None
2026-03-29 10:45:27 [auto1.de] INFO: Scrape type for ZH41953: 0
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: SV69616
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: GS82653
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS82653%27 HTTP/1.1" 200 None
2026-03-29 10:45:27 [auto1.de] INFO: Scrape type for GS82653: 0
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: EN87643
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN87643%27 HTTP/1.1" 200 None
2026-03-29 10:45:27 [auto1.de] INFO: Scrape type for EN87643: 0
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: HM56533
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM56533%27 HTTP/1.1" 200 None
2026-03-29 10:45:27 [auto1.de] INFO: Scrape type for HM56533: 0
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: DY27021
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY27021%27 HTTP/1.1" 200 None
2026-03-29 10:45:27 [auto1.de] INFO: Scrape type for DY27021: 0
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: VB56822
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: EB81332
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: DD20559
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: HM11779
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: CU93791
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: SG31546
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: LL85069
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL85069%27 HTTP/1.1" 200 None
2026-03-29 10:45:27 [auto1.de] INFO: Scrape type for LL85069: 0
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: EG81564
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG81564%27 HTTP/1.1" 200 None
2026-03-29 10:45:27 [auto1.de] INFO: Scrape type for EG81564: 0
2026-03-29 10:45:27 [auto1.de] INFO: Found listing with ID: RV94916
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV94916%27 HTTP/1.1" 200 None
2026-03-29 10:45:27 [auto1.de] INFO: Scrape type for RV94916: 0
2026-03-29 10:45:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:45:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:45:28 [auto1.de] INFO: Channel: 24h | Page: 132 | totalHits: 6726 | hits on page: 40
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: NZ68458
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: JZ63393
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ63393%27 HTTP/1.1" 200 None
2026-03-29 10:45:28 [auto1.de] INFO: Scrape type for JZ63393: 0
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: XX23158
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX23158%27 HTTP/1.1" 200 None
2026-03-29 10:45:28 [auto1.de] INFO: Scrape type for XX23158: 0
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: CU11315
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: BS60844
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS60844%27 HTTP/1.1" 200 None
2026-03-29 10:45:28 [auto1.de] INFO: Scrape type for BS60844: 0
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: GW98108
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW98108%27 HTTP/1.1" 200 None
2026-03-29 10:45:28 [auto1.de] INFO: Scrape type for GW98108: 0
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: XJ99289
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ99289%27 HTTP/1.1" 200 None
2026-03-29 10:45:28 [auto1.de] INFO: Scrape type for XJ99289: 0
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: CD13649
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: VP61348
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP61348%27 HTTP/1.1" 200 None
2026-03-29 10:45:28 [auto1.de] INFO: Scrape type for VP61348: 0
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: KW68536
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: CY66130
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY66130%27 HTTP/1.1" 200 None
2026-03-29 10:45:28 [auto1.de] INFO: Scrape type for CY66130: 0
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: BP82527
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: FX32627
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: NZ21452
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ21452%27 HTTP/1.1" 200 None
2026-03-29 10:45:28 [auto1.de] INFO: Scrape type for NZ21452: 0
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: VM53714
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM53714%27 HTTP/1.1" 200 None
2026-03-29 10:45:28 [auto1.de] INFO: Scrape type for VM53714: 0
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: KH87635
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH87635%27 HTTP/1.1" 200 None
2026-03-29 10:45:28 [auto1.de] INFO: Scrape type for KH87635: 0
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: ER89217
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: FN51585
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN51585%27 HTTP/1.1" 200 None
2026-03-29 10:45:28 [auto1.de] INFO: Scrape type for FN51585: 0
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: XM89515
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: AE67956
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE67956%27 HTTP/1.1" 200 None
2026-03-29 10:45:28 [auto1.de] INFO: Scrape type for AE67956: 0
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: BX10295
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: PB15916
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB15916%27 HTTP/1.1" 200 None
2026-03-29 10:45:28 [auto1.de] INFO: Scrape type for PB15916: 0
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: DA58180
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA58180%27 HTTP/1.1" 200 None
2026-03-29 10:45:28 [auto1.de] INFO: Scrape type for DA58180: 0
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: NA39997
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA39997%27 HTTP/1.1" 200 None
2026-03-29 10:45:28 [auto1.de] INFO: Scrape type for NA39997: 0
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: KV56224
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: SR34905
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR34905%27 HTTP/1.1" 200 None
2026-03-29 10:45:28 [auto1.de] INFO: Scrape type for SR34905: 0
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: YM11561
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: RR41525
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: XR30933
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR30933%27 HTTP/1.1" 200 None
2026-03-29 10:45:28 [auto1.de] INFO: Scrape type for XR30933: 0
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: XB63753
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: ZF73856
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF73856%27 HTTP/1.1" 200 None
2026-03-29 10:45:28 [auto1.de] INFO: Scrape type for ZF73856: 0
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: MK56565
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK56565%27 HTTP/1.1" 200 None
2026-03-29 10:45:28 [auto1.de] INFO: Scrape type for MK56565: 0
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: ME72354
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME72354%27 HTTP/1.1" 200 None
2026-03-29 10:45:28 [auto1.de] INFO: Scrape type for ME72354: 0
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: BZ79041
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ79041%27 HTTP/1.1" 200 None
2026-03-29 10:45:28 [auto1.de] INFO: Scrape type for BZ79041: 0
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: KV52621
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV52621%27 HTTP/1.1" 200 None
2026-03-29 10:45:28 [auto1.de] INFO: Scrape type for KV52621: 0
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: SW13301
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW13301%27 HTTP/1.1" 200 None
2026-03-29 10:45:28 [auto1.de] INFO: Scrape type for SW13301: 0
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: ER51805
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER51805%27 HTTP/1.1" 200 None
2026-03-29 10:45:28 [auto1.de] INFO: Scrape type for ER51805: 0
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: VY78817
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: SS31762
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS31762%27 HTTP/1.1" 200 None
2026-03-29 10:45:28 [auto1.de] INFO: Scrape type for SS31762: 0
2026-03-29 10:45:28 [auto1.de] INFO: Found listing with ID: GS86907
2026-03-29 10:45:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:45:29 [auto1.de] INFO: Channel: 24h | Page: 133 | totalHits: 6726 | hits on page: 40
2026-03-29 10:45:29 [auto1.de] INFO: Found listing with ID: FN01227
2026-03-29 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN01227%27 HTTP/1.1" 200 None
2026-03-29 10:45:29 [auto1.de] INFO: Scrape type for FN01227: 0
2026-03-29 10:45:29 [auto1.de] INFO: Found listing with ID: BX26482
2026-03-29 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX26482%27 HTTP/1.1" 200 None
2026-03-29 10:45:29 [auto1.de] INFO: Scrape type for BX26482: 0
2026-03-29 10:45:29 [auto1.de] INFO: Found listing with ID: RC49554
2026-03-29 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC49554%27 HTTP/1.1" 200 None
2026-03-29 10:45:29 [auto1.de] INFO: Scrape type for RC49554: 0
2026-03-29 10:45:29 [auto1.de] INFO: Found listing with ID: RA95780
2026-03-29 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA95780%27 HTTP/1.1" 200 None
2026-03-29 10:45:29 [auto1.de] INFO: Scrape type for RA95780: 0
2026-03-29 10:45:29 [auto1.de] INFO: Found listing with ID: MK04993
2026-03-29 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK04993%27 HTTP/1.1" 200 None
2026-03-29 10:45:29 [auto1.de] INFO: Scrape type for MK04993: 0
2026-03-29 10:45:29 [auto1.de] INFO: Found listing with ID: LK83365
2026-03-29 10:45:29 [auto1.de] INFO: Found listing with ID: YS84502
2026-03-29 10:45:29 [auto1.de] INFO: Found listing with ID: VR01853
2026-03-29 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR01853%27 HTTP/1.1" 200 None
2026-03-29 10:45:29 [auto1.de] INFO: Scrape type for VR01853: 0
2026-03-29 10:45:29 [auto1.de] INFO: Found listing with ID: CW50467
2026-03-29 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW50467%27 HTTP/1.1" 200 None
2026-03-29 10:45:29 [auto1.de] INFO: Scrape type for CW50467: 0
2026-03-29 10:45:29 [auto1.de] INFO: Found listing with ID: FJ09626
2026-03-29 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ09626%27 HTTP/1.1" 200 None
2026-03-29 10:45:29 [auto1.de] INFO: Scrape type for FJ09626: 0
2026-03-29 10:45:29 [auto1.de] INFO: Found listing with ID: LJ58036
2026-03-29 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ58036%27 HTTP/1.1" 200 None
2026-03-29 10:45:29 [auto1.de] INFO: Scrape type for LJ58036: 2
2026-03-29 10:45:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96122428-d793-559c-8524-837455f005f7 with identifier: LJ58036
2026-03-29 10:45:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96122428-d793-559c-8524-837455f005f7 with scrape type 2
2026-03-29 10:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96122428-d793-559c-8524-837455f005f7 with scrape type 2
2026-03-29 10:45:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96122428-d793-559c-8524-837455f005f7, identifier: LJ58036
2026-03-29 10:45:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96122428-d793-559c-8524-837455f005f7 with identifier: LJ58036
2026-03-29 10:45:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96122428-d793-559c-8524-837455f005f7 with identifier: LJ58036
2026-03-29 10:45:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96122428-d793-559c-8524-837455f005f7 with identifier: LJ58036 to the API
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:45:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:17:10Z',
 'fuel_type': 'petrol',
 'id': '96122428-d793-559c-8524-837455f005f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ58036',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 146505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-09',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Kompressor T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2009}
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ58036%27 HTTP/1.1" 200 None
2026-03-29 10:45:30 [auto1.de] INFO: Saving data for LJ58036: {'auction_closing_time': 1774883830.0, 'created_time': 1774510535.21847, 'last_price_update_time': 1774781130.496429}
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ58036') HTTP/1.1" 204 0
2026-03-29 10:45:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:45:30 [auto1.de] INFO: Found listing with ID: UL59525
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL59525%27 HTTP/1.1" 200 None
2026-03-29 10:45:30 [auto1.de] INFO: Scrape type for UL59525: 0
2026-03-29 10:45:30 [auto1.de] INFO: Found listing with ID: HH06694
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH06694%27 HTTP/1.1" 200 None
2026-03-29 10:45:30 [auto1.de] INFO: Scrape type for HH06694: 0
2026-03-29 10:45:30 [auto1.de] INFO: Found listing with ID: GH08686
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH08686%27 HTTP/1.1" 200 None
2026-03-29 10:45:30 [auto1.de] INFO: Scrape type for GH08686: 0
2026-03-29 10:45:30 [auto1.de] INFO: Found listing with ID: XB90216
2026-03-29 10:45:30 [auto1.de] INFO: Found listing with ID: CM33145
2026-03-29 10:45:30 [auto1.de] INFO: Found listing with ID: EV68047
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV68047%27 HTTP/1.1" 200 None
2026-03-29 10:45:30 [auto1.de] INFO: Scrape type for EV68047: 0
2026-03-29 10:45:30 [auto1.de] INFO: Found listing with ID: GR02584
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR02584%27 HTTP/1.1" 200 None
2026-03-29 10:45:30 [auto1.de] INFO: Scrape type for GR02584: 0
2026-03-29 10:45:30 [auto1.de] INFO: Found listing with ID: MT67219
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT67219%27 HTTP/1.1" 200 None
2026-03-29 10:45:30 [auto1.de] INFO: Scrape type for MT67219: 0
2026-03-29 10:45:30 [auto1.de] INFO: Found listing with ID: CZ44674
2026-03-29 10:45:30 [auto1.de] INFO: Found listing with ID: HP53076
2026-03-29 10:45:30 [auto1.de] INFO: Found listing with ID: VV90195
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV90195%27 HTTP/1.1" 200 None
2026-03-29 10:45:30 [auto1.de] INFO: Scrape type for VV90195: 0
2026-03-29 10:45:30 [auto1.de] INFO: Found listing with ID: NL93561
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL93561%27 HTTP/1.1" 200 None
2026-03-29 10:45:30 [auto1.de] INFO: Scrape type for NL93561: 0
2026-03-29 10:45:30 [auto1.de] INFO: Found listing with ID: ED94101
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED94101%27 HTTP/1.1" 200 None
2026-03-29 10:45:30 [auto1.de] INFO: Scrape type for ED94101: 0
2026-03-29 10:45:30 [auto1.de] INFO: Found listing with ID: HV99123
2026-03-29 10:45:30 [auto1.de] INFO: Found listing with ID: FR95379
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR95379%27 HTTP/1.1" 200 None
2026-03-29 10:45:30 [auto1.de] INFO: Scrape type for FR95379: 0
2026-03-29 10:45:30 [auto1.de] INFO: Found listing with ID: NV40301
2026-03-29 10:45:30 [auto1.de] INFO: Found listing with ID: HK09580
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK09580%27 HTTP/1.1" 200 None
2026-03-29 10:45:30 [auto1.de] INFO: Scrape type for HK09580: 0
2026-03-29 10:45:30 [auto1.de] INFO: Found listing with ID: KP72135
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP72135%27 HTTP/1.1" 200 None
2026-03-29 10:45:30 [auto1.de] INFO: Scrape type for KP72135: 0
2026-03-29 10:45:30 [auto1.de] INFO: Found listing with ID: ZE10872
2026-03-29 10:45:30 [auto1.de] INFO: Found listing with ID: SG08680
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG08680%27 HTTP/1.1" 200 None
2026-03-29 10:45:30 [auto1.de] INFO: Scrape type for SG08680: 0
2026-03-29 10:45:30 [auto1.de] INFO: Found listing with ID: HG24809
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG24809%27 HTTP/1.1" 200 None
2026-03-29 10:45:30 [auto1.de] INFO: Scrape type for HG24809: 0
2026-03-29 10:45:30 [auto1.de] INFO: Found listing with ID: XP92221
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP92221%27 HTTP/1.1" 200 None
2026-03-29 10:45:30 [auto1.de] INFO: Scrape type for XP92221: 0
2026-03-29 10:45:30 [auto1.de] INFO: Found listing with ID: TN09859
2026-03-29 10:45:30 [auto1.de] INFO: Found listing with ID: BH21613
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH21613%27 HTTP/1.1" 200 None
2026-03-29 10:45:30 [auto1.de] INFO: Scrape type for BH21613: 0
2026-03-29 10:45:30 [auto1.de] INFO: Found listing with ID: LL82276
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL82276%27 HTTP/1.1" 200 None
2026-03-29 10:45:30 [auto1.de] INFO: Scrape type for LL82276: 0
2026-03-29 10:45:30 [auto1.de] INFO: Found listing with ID: AY38359
2026-03-29 10:45:30 [auto1.de] INFO: Found listing with ID: AB05978
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB05978%27 HTTP/1.1" 200 None
2026-03-29 10:45:30 [auto1.de] INFO: Scrape type for AB05978: 0
2026-03-29 10:45:30 [auto1.de] INFO: Found listing with ID: ZL89473
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL89473%27 HTTP/1.1" 200 None
2026-03-29 10:45:30 [auto1.de] INFO: Scrape type for ZL89473: 0
2026-03-29 10:45:30 [auto1.de] INFO: Found listing with ID: GN37925
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN37925%27 HTTP/1.1" 200 None
2026-03-29 10:45:30 [auto1.de] INFO: Scrape type for GN37925: 0
2026-03-29 10:45:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:45:31 [auto1.de] INFO: Channel: 24h | Page: 134 | totalHits: 6726 | hits on page: 40
2026-03-29 10:45:31 [auto1.de] INFO: Found listing with ID: ZF02079
2026-03-29 10:45:31 [auto1.de] INFO: Found listing with ID: BX27927
2026-03-29 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX27927%27 HTTP/1.1" 200 None
2026-03-29 10:45:31 [auto1.de] INFO: Scrape type for BX27927: 0
2026-03-29 10:45:31 [auto1.de] INFO: Found listing with ID: BX19940
2026-03-29 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX19940%27 HTTP/1.1" 200 None
2026-03-29 10:45:31 [auto1.de] INFO: Scrape type for BX19940: 0
2026-03-29 10:45:31 [auto1.de] INFO: Found listing with ID: WS31989
2026-03-29 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS31989%27 HTTP/1.1" 200 None
2026-03-29 10:45:31 [auto1.de] INFO: Scrape type for WS31989: 0
2026-03-29 10:45:31 [auto1.de] INFO: Found listing with ID: SB81454
2026-03-29 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB81454%27 HTTP/1.1" 200 None
2026-03-29 10:45:31 [auto1.de] INFO: Scrape type for SB81454: 0
2026-03-29 10:45:31 [auto1.de] INFO: Found listing with ID: MD58686
2026-03-29 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD58686%27 HTTP/1.1" 200 None
2026-03-29 10:45:31 [auto1.de] INFO: Scrape type for MD58686: 0
2026-03-29 10:45:31 [auto1.de] INFO: Found listing with ID: LR15690
2026-03-29 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR15690%27 HTTP/1.1" 200 None
2026-03-29 10:45:31 [auto1.de] INFO: Scrape type for LR15690: 0
2026-03-29 10:45:31 [auto1.de] INFO: Found listing with ID: FZ40219
2026-03-29 10:45:31 [auto1.de] INFO: Found listing with ID: SG38319
2026-03-29 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG38319%27 HTTP/1.1" 200 None
2026-03-29 10:45:31 [auto1.de] INFO: Scrape type for SG38319: 0
2026-03-29 10:45:31 [auto1.de] INFO: Found listing with ID: JS15071
2026-03-29 10:45:31 [auto1.de] INFO: Found listing with ID: DZ84842
2026-03-29 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ84842%27 HTTP/1.1" 200 None
2026-03-29 10:45:31 [auto1.de] INFO: Scrape type for DZ84842: 0
2026-03-29 10:45:31 [auto1.de] INFO: Found listing with ID: AY73359
2026-03-29 10:45:31 [auto1.de] INFO: Found listing with ID: PR96123
2026-03-29 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR96123%27 HTTP/1.1" 200 None
2026-03-29 10:45:31 [auto1.de] INFO: Scrape type for PR96123: 0
2026-03-29 10:45:31 [auto1.de] INFO: Found listing with ID: FV65723
2026-03-29 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV65723%27 HTTP/1.1" 200 None
2026-03-29 10:45:31 [auto1.de] INFO: Scrape type for FV65723: 0
2026-03-29 10:45:31 [auto1.de] INFO: Found listing with ID: FW41048
2026-03-29 10:45:31 [auto1.de] INFO: Found listing with ID: CZ58938
2026-03-29 10:45:31 [auto1.de] INFO: Found listing with ID: SN98432
2026-03-29 10:45:31 [auto1.de] INFO: Found listing with ID: KS57096
2026-03-29 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS57096%27 HTTP/1.1" 200 None
2026-03-29 10:45:31 [auto1.de] INFO: Scrape type for KS57096: 0
2026-03-29 10:45:31 [auto1.de] INFO: Found listing with ID: AR79819
2026-03-29 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR79819%27 HTTP/1.1" 200 None
2026-03-29 10:45:31 [auto1.de] INFO: Scrape type for AR79819: 0
2026-03-29 10:45:31 [auto1.de] INFO: Found listing with ID: XT08525
2026-03-29 10:45:31 [auto1.de] INFO: Found listing with ID: GL59385
2026-03-29 10:45:31 [auto1.de] INFO: Found listing with ID: FL14438
2026-03-29 10:45:31 [auto1.de] INFO: Found listing with ID: MA47632
2026-03-29 10:45:31 [auto1.de] INFO: Found listing with ID: GE53934
2026-03-29 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE53934%27 HTTP/1.1" 200 None
2026-03-29 10:45:31 [auto1.de] INFO: Scrape type for GE53934: 0
2026-03-29 10:45:31 [auto1.de] INFO: Found listing with ID: MZ82429
2026-03-29 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ82429%27 HTTP/1.1" 200 None
2026-03-29 10:45:31 [auto1.de] INFO: Scrape type for MZ82429: 0
2026-03-29 10:45:31 [auto1.de] INFO: Found listing with ID: AP13896
2026-03-29 10:45:31 [auto1.de] INFO: Found listing with ID: HX75388
2026-03-29 10:45:31 [auto1.de] INFO: Found listing with ID: AB05570
2026-03-29 10:45:31 [auto1.de] INFO: Found listing with ID: GX10720
2026-03-29 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX10720%27 HTTP/1.1" 200 None
2026-03-29 10:45:31 [auto1.de] INFO: Scrape type for GX10720: 0
2026-03-29 10:45:31 [auto1.de] INFO: Found listing with ID: AP92874
2026-03-29 10:45:31 [auto1.de] INFO: Found listing with ID: LU16486
2026-03-29 10:45:31 [auto1.de] INFO: Found listing with ID: UB05903
2026-03-29 10:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB05903%27 HTTP/1.1" 200 None
2026-03-29 10:45:32 [auto1.de] INFO: Scrape type for UB05903: 0
2026-03-29 10:45:32 [auto1.de] INFO: Found listing with ID: KA14077
2026-03-29 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA14077%27 HTTP/1.1" 200 None
2026-03-29 10:45:32 [auto1.de] INFO: Scrape type for KA14077: 0
2026-03-29 10:45:32 [auto1.de] INFO: Found listing with ID: WD47381
2026-03-29 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD47381%27 HTTP/1.1" 200 None
2026-03-29 10:45:32 [auto1.de] INFO: Scrape type for WD47381: 0
2026-03-29 10:45:32 [auto1.de] INFO: Found listing with ID: PT15230
2026-03-29 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT15230%27 HTTP/1.1" 200 None
2026-03-29 10:45:32 [auto1.de] INFO: Scrape type for PT15230: 0
2026-03-29 10:45:32 [auto1.de] INFO: Found listing with ID: CL18387
2026-03-29 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL18387%27 HTTP/1.1" 200 None
2026-03-29 10:45:32 [auto1.de] INFO: Scrape type for CL18387: 0
2026-03-29 10:45:32 [auto1.de] INFO: Found listing with ID: XP03484
2026-03-29 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP03484%27 HTTP/1.1" 200 None
2026-03-29 10:45:32 [auto1.de] INFO: Scrape type for XP03484: 0
2026-03-29 10:45:32 [auto1.de] INFO: Found listing with ID: PN41265
2026-03-29 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN41265%27 HTTP/1.1" 200 None
2026-03-29 10:45:32 [auto1.de] INFO: Scrape type for PN41265: 0
2026-03-29 10:45:32 [auto1.de] INFO: Found listing with ID: TV60687
2026-03-29 10:45:32 [auto1.de] INFO: Found listing with ID: KJ75418
2026-03-29 10:45:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:45:33 [auto1.de] INFO: Channel: 24h | Page: 135 | totalHits: 6726 | hits on page: 40
2026-03-29 10:45:33 [auto1.de] INFO: Found listing with ID: EP39271
2026-03-29 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP39271%27 HTTP/1.1" 200 None
2026-03-29 10:45:33 [auto1.de] INFO: Scrape type for EP39271: 0
2026-03-29 10:45:33 [auto1.de] INFO: Found listing with ID: KE73798
2026-03-29 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE73798%27 HTTP/1.1" 200 None
2026-03-29 10:45:33 [auto1.de] INFO: Scrape type for KE73798: 0
2026-03-29 10:45:33 [auto1.de] INFO: Found listing with ID: RH12349
2026-03-29 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH12349%27 HTTP/1.1" 200 None
2026-03-29 10:45:33 [auto1.de] INFO: Scrape type for RH12349: 0
2026-03-29 10:45:33 [auto1.de] INFO: Found listing with ID: CA50565
2026-03-29 10:45:33 [auto1.de] INFO: Found listing with ID: PR23658
2026-03-29 10:45:33 [auto1.de] INFO: Found listing with ID: SX40224
2026-03-29 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX40224%27 HTTP/1.1" 200 None
2026-03-29 10:45:33 [auto1.de] INFO: Scrape type for SX40224: 0
2026-03-29 10:45:33 [auto1.de] INFO: Found listing with ID: SK86846
2026-03-29 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK86846%27 HTTP/1.1" 200 None
2026-03-29 10:45:33 [auto1.de] INFO: Scrape type for SK86846: 0
2026-03-29 10:45:33 [auto1.de] INFO: Found listing with ID: XN42361
2026-03-29 10:45:33 [auto1.de] INFO: Found listing with ID: GE73392
2026-03-29 10:45:33 [auto1.de] INFO: Found listing with ID: PF90530
2026-03-29 10:45:33 [auto1.de] INFO: Found listing with ID: LX68947
2026-03-29 10:45:33 [auto1.de] INFO: Found listing with ID: VN58705
2026-03-29 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN58705%27 HTTP/1.1" 200 None
2026-03-29 10:45:33 [auto1.de] INFO: Scrape type for VN58705: 0
2026-03-29 10:45:33 [auto1.de] INFO: Found listing with ID: XB16241
2026-03-29 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB16241%27 HTTP/1.1" 200 None
2026-03-29 10:45:33 [auto1.de] INFO: Scrape type for XB16241: 0
2026-03-29 10:45:33 [auto1.de] INFO: Found listing with ID: ZW26780
2026-03-29 10:45:33 [auto1.de] INFO: Found listing with ID: DC45431
2026-03-29 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC45431%27 HTTP/1.1" 200 None
2026-03-29 10:45:34 [auto1.de] INFO: Scrape type for DC45431: 0
2026-03-29 10:45:34 [auto1.de] INFO: Found listing with ID: JY30583
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY30583%27 HTTP/1.1" 200 None
2026-03-29 10:45:34 [auto1.de] INFO: Scrape type for JY30583: 0
2026-03-29 10:45:34 [auto1.de] INFO: Found listing with ID: PU37095
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU37095%27 HTTP/1.1" 200 None
2026-03-29 10:45:34 [auto1.de] INFO: Scrape type for PU37095: 0
2026-03-29 10:45:34 [auto1.de] INFO: Found listing with ID: DA75557
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA75557%27 HTTP/1.1" 200 None
2026-03-29 10:45:34 [auto1.de] INFO: Scrape type for DA75557: 0
2026-03-29 10:45:34 [auto1.de] INFO: Found listing with ID: FS06029
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS06029%27 HTTP/1.1" 200 None
2026-03-29 10:45:34 [auto1.de] INFO: Scrape type for FS06029: 0
2026-03-29 10:45:34 [auto1.de] INFO: Found listing with ID: CT18435
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT18435%27 HTTP/1.1" 200 None
2026-03-29 10:45:34 [auto1.de] INFO: Scrape type for CT18435: 0
2026-03-29 10:45:34 [auto1.de] INFO: Found listing with ID: WL45042
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL45042%27 HTTP/1.1" 200 None
2026-03-29 10:45:34 [auto1.de] INFO: Scrape type for WL45042: 0
2026-03-29 10:45:34 [auto1.de] INFO: Found listing with ID: VX06464
2026-03-29 10:45:34 [auto1.de] INFO: Found listing with ID: TE62268
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE62268%27 HTTP/1.1" 200 None
2026-03-29 10:45:34 [auto1.de] INFO: Scrape type for TE62268: 0
2026-03-29 10:45:34 [auto1.de] INFO: Found listing with ID: DV26733
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV26733%27 HTTP/1.1" 200 None
2026-03-29 10:45:34 [auto1.de] INFO: Scrape type for DV26733: 0
2026-03-29 10:45:34 [auto1.de] INFO: Found listing with ID: MC25913
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC25913%27 HTTP/1.1" 200 None
2026-03-29 10:45:34 [auto1.de] INFO: Scrape type for MC25913: 0
2026-03-29 10:45:34 [auto1.de] INFO: Found listing with ID: JA93486
2026-03-29 10:45:34 [auto1.de] INFO: Found listing with ID: WJ52581
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ52581%27 HTTP/1.1" 200 None
2026-03-29 10:45:34 [auto1.de] INFO: Scrape type for WJ52581: 0
2026-03-29 10:45:34 [auto1.de] INFO: Found listing with ID: GJ53227
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ53227%27 HTTP/1.1" 200 None
2026-03-29 10:45:34 [auto1.de] INFO: Scrape type for GJ53227: 0
2026-03-29 10:45:34 [auto1.de] INFO: Found listing with ID: DB69488
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB69488%27 HTTP/1.1" 200 None
2026-03-29 10:45:34 [auto1.de] INFO: Scrape type for DB69488: 0
2026-03-29 10:45:34 [auto1.de] INFO: Found listing with ID: UC09176
2026-03-29 10:45:34 [auto1.de] INFO: Found listing with ID: MH48828
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH48828%27 HTTP/1.1" 200 None
2026-03-29 10:45:34 [auto1.de] INFO: Scrape type for MH48828: 0
2026-03-29 10:45:34 [auto1.de] INFO: Found listing with ID: XS07294
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS07294%27 HTTP/1.1" 200 None
2026-03-29 10:45:34 [auto1.de] INFO: Scrape type for XS07294: 0
2026-03-29 10:45:34 [auto1.de] INFO: Found listing with ID: MU28825
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU28825%27 HTTP/1.1" 200 None
2026-03-29 10:45:34 [auto1.de] INFO: Scrape type for MU28825: 0
2026-03-29 10:45:34 [auto1.de] INFO: Found listing with ID: VY02082
2026-03-29 10:45:34 [auto1.de] INFO: Found listing with ID: HR12459
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR12459%27 HTTP/1.1" 200 None
2026-03-29 10:45:34 [auto1.de] INFO: Scrape type for HR12459: 0
2026-03-29 10:45:34 [auto1.de] INFO: Found listing with ID: DE09566
2026-03-29 10:45:34 [auto1.de] INFO: Found listing with ID: PH00058
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH00058%27 HTTP/1.1" 200 None
2026-03-29 10:45:34 [auto1.de] INFO: Scrape type for PH00058: 0
2026-03-29 10:45:34 [auto1.de] INFO: Found listing with ID: KU48054
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU48054%27 HTTP/1.1" 200 None
2026-03-29 10:45:34 [auto1.de] INFO: Scrape type for KU48054: 0
2026-03-29 10:45:34 [auto1.de] INFO: Found listing with ID: HD78649
2026-03-29 10:45:34 [auto1.de] INFO: Found listing with ID: KA69017
2026-03-29 10:45:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:45:53 [auto1.de] INFO: Channel: 24h | Page: 136 | totalHits: 6726 | hits on page: 40
2026-03-29 10:45:53 [auto1.de] INFO: Found listing with ID: UG82717
2026-03-29 10:45:53 [auto1.de] INFO: Found listing with ID: SF51688
2026-03-29 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF51688%27 HTTP/1.1" 200 None
2026-03-29 10:45:53 [auto1.de] INFO: Scrape type for SF51688: 0
2026-03-29 10:45:53 [auto1.de] INFO: Found listing with ID: KR60146
2026-03-29 10:45:53 [auto1.de] INFO: Found listing with ID: JH22526
2026-03-29 10:45:53 [auto1.de] INFO: Found listing with ID: VW78119
2026-03-29 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW78119%27 HTTP/1.1" 200 None
2026-03-29 10:45:53 [auto1.de] INFO: Scrape type for VW78119: 0
2026-03-29 10:45:53 [auto1.de] INFO: Found listing with ID: WC14239
2026-03-29 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC14239%27 HTTP/1.1" 200 None
2026-03-29 10:45:53 [auto1.de] INFO: Scrape type for WC14239: 0
2026-03-29 10:45:53 [auto1.de] INFO: Found listing with ID: DG34410
2026-03-29 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG34410%27 HTTP/1.1" 200 None
2026-03-29 10:45:53 [auto1.de] INFO: Scrape type for DG34410: 0
2026-03-29 10:45:53 [auto1.de] INFO: Found listing with ID: UG36008
2026-03-29 10:45:53 [auto1.de] INFO: Found listing with ID: UP16968
2026-03-29 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP16968%27 HTTP/1.1" 200 None
2026-03-29 10:45:53 [auto1.de] INFO: Scrape type for UP16968: 0
2026-03-29 10:45:53 [auto1.de] INFO: Found listing with ID: AT56964
2026-03-29 10:45:53 [auto1.de] INFO: Found listing with ID: XH60803
2026-03-29 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH60803%27 HTTP/1.1" 200 None
2026-03-29 10:45:53 [auto1.de] INFO: Scrape type for XH60803: 0
2026-03-29 10:45:53 [auto1.de] INFO: Found listing with ID: TM50766
2026-03-29 10:45:53 [auto1.de] INFO: Found listing with ID: YH55403
2026-03-29 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH55403%27 HTTP/1.1" 200 None
2026-03-29 10:45:53 [auto1.de] INFO: Scrape type for YH55403: 0
2026-03-29 10:45:53 [auto1.de] INFO: Found listing with ID: ED54075
2026-03-29 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED54075%27 HTTP/1.1" 200 None
2026-03-29 10:45:53 [auto1.de] INFO: Scrape type for ED54075: 0
2026-03-29 10:45:53 [auto1.de] INFO: Found listing with ID: LG62730
2026-03-29 10:45:53 [auto1.de] INFO: Found listing with ID: CN67479
2026-03-29 10:45:53 [auto1.de] INFO: Found listing with ID: XB63697
2026-03-29 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB63697%27 HTTP/1.1" 200 None
2026-03-29 10:45:53 [auto1.de] INFO: Scrape type for XB63697: 0
2026-03-29 10:45:53 [auto1.de] INFO: Found listing with ID: TG50792
2026-03-29 10:45:53 [auto1.de] INFO: Found listing with ID: KV45181
2026-03-29 10:45:53 [auto1.de] INFO: Found listing with ID: XS50717
2026-03-29 10:45:53 [auto1.de] INFO: Found listing with ID: TK47054
2026-03-29 10:45:53 [auto1.de] INFO: Found listing with ID: LM30127
2026-03-29 10:45:53 [auto1.de] INFO: Found listing with ID: PE74408
2026-03-29 10:45:53 [auto1.de] INFO: Found listing with ID: AA34634
2026-03-29 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA34634%27 HTTP/1.1" 200 None
2026-03-29 10:45:53 [auto1.de] INFO: Scrape type for AA34634: 0
2026-03-29 10:45:53 [auto1.de] INFO: Found listing with ID: TR13972
2026-03-29 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR13972%27 HTTP/1.1" 200 None
2026-03-29 10:45:53 [auto1.de] INFO: Scrape type for TR13972: 2
2026-03-29 10:45:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55562edd-05c9-53a6-8b99-5d825810cd48 with identifier: TR13972
2026-03-29 10:45:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55562edd-05c9-53a6-8b99-5d825810cd48 with scrape type 2
2026-03-29 10:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55562edd-05c9-53a6-8b99-5d825810cd48 with scrape type 2
2026-03-29 10:45:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55562edd-05c9-53a6-8b99-5d825810cd48, identifier: TR13972
2026-03-29 10:45:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55562edd-05c9-53a6-8b99-5d825810cd48 with identifier: TR13972
2026-03-29 10:45:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55562edd-05c9-53a6-8b99-5d825810cd48 with identifier: TR13972
2026-03-29 10:45:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55562edd-05c9-53a6-8b99-5d825810cd48 with identifier: TR13972 to the API
2026-03-29 10:45:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:45:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:45:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 238,
 'expiration_date': '2026-03-30T15:14:08Z',
 'fuel_type': 'petrol',
 'id': '55562edd-05c9-53a6-8b99-5d825810cd48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR13972',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'S-TYPE',
 'odometer': 192016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-08-26',
 'seller_name': None,
 'title': 'Jaguar S-TYPE 3.0 V6',
 'transmission': 'automatic',
 'trim': '',
 'year': 1999}
2026-03-29 10:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR13972%27 HTTP/1.1" 200 None
2026-03-29 10:45:54 [auto1.de] INFO: Saving data for TR13972: {'auction_closing_time': 1774883648.0, 'created_time': 1774510537.288954, 'last_price_update_time': 1774781154.345075}
2026-03-29 10:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR13972') HTTP/1.1" 204 0
2026-03-29 10:45:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:45:54 [auto1.de] INFO: Found listing with ID: TB72166
2026-03-29 10:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB72166%27 HTTP/1.1" 200 None
2026-03-29 10:45:54 [auto1.de] INFO: Scrape type for TB72166: 0
2026-03-29 10:45:54 [auto1.de] INFO: Found listing with ID: RW09760
2026-03-29 10:45:54 [auto1.de] INFO: Found listing with ID: VX15000
2026-03-29 10:45:54 [auto1.de] INFO: Found listing with ID: GK82878
2026-03-29 10:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK82878%27 HTTP/1.1" 200 None
2026-03-29 10:45:54 [auto1.de] INFO: Scrape type for GK82878: 0
2026-03-29 10:45:54 [auto1.de] INFO: Found listing with ID: AH76263
2026-03-29 10:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH76263%27 HTTP/1.1" 200 None
2026-03-29 10:45:54 [auto1.de] INFO: Scrape type for AH76263: 0
2026-03-29 10:45:54 [auto1.de] INFO: Found listing with ID: RE17291
2026-03-29 10:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE17291%27 HTTP/1.1" 200 None
2026-03-29 10:45:54 [auto1.de] INFO: Scrape type for RE17291: 0
2026-03-29 10:45:54 [auto1.de] INFO: Found listing with ID: FW17566
2026-03-29 10:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW17566%27 HTTP/1.1" 200 None
2026-03-29 10:45:54 [auto1.de] INFO: Scrape type for FW17566: 0
2026-03-29 10:45:54 [auto1.de] INFO: Found listing with ID: KZ08446
2026-03-29 10:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ08446%27 HTTP/1.1" 200 None
2026-03-29 10:45:54 [auto1.de] INFO: Scrape type for KZ08446: 0
2026-03-29 10:45:54 [auto1.de] INFO: Found listing with ID: JE63209
2026-03-29 10:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE63209%27 HTTP/1.1" 200 None
2026-03-29 10:45:54 [auto1.de] INFO: Scrape type for JE63209: 0
2026-03-29 10:45:54 [auto1.de] INFO: Found listing with ID: XF69711
2026-03-29 10:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF69711%27 HTTP/1.1" 200 None
2026-03-29 10:45:54 [auto1.de] INFO: Scrape type for XF69711: 0
2026-03-29 10:45:54 [auto1.de] INFO: Found listing with ID: LG14715
2026-03-29 10:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG14715%27 HTTP/1.1" 200 None
2026-03-29 10:45:54 [auto1.de] INFO: Scrape type for LG14715: 0
2026-03-29 10:45:54 [auto1.de] INFO: Found listing with ID: CC75051
2026-03-29 10:45:54 [auto1.de] INFO: Found listing with ID: BU80975
2026-03-29 10:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU80975%27 HTTP/1.1" 200 None
2026-03-29 10:45:54 [auto1.de] INFO: Scrape type for BU80975: 0
2026-03-29 10:45:54 [auto1.de] INFO: Found listing with ID: BF92726
2026-03-29 10:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF92726%27 HTTP/1.1" 200 None
2026-03-29 10:45:54 [auto1.de] INFO: Scrape type for BF92726: 0
2026-03-29 10:45:54 [auto1.de] INFO: Found listing with ID: WK73067
2026-03-29 10:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:46:06 [auto1.de] INFO: Channel: 24h | Page: 137 | totalHits: 6726 | hits on page: 40
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: DP00162
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP00162%27 HTTP/1.1" 200 None
2026-03-29 10:46:06 [auto1.de] INFO: Scrape type for DP00162: 0
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: BB37977
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB37977%27 HTTP/1.1" 200 None
2026-03-29 10:46:06 [auto1.de] INFO: Scrape type for BB37977: 0
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: XR27730
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR27730%27 HTTP/1.1" 200 None
2026-03-29 10:46:06 [auto1.de] INFO: Scrape type for XR27730: 0
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: MK34658
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK34658%27 HTTP/1.1" 200 None
2026-03-29 10:46:06 [auto1.de] INFO: Scrape type for MK34658: 0
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: YV93929
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV93929%27 HTTP/1.1" 200 None
2026-03-29 10:46:06 [auto1.de] INFO: Scrape type for YV93929: 0
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: YZ02891
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ02891%27 HTTP/1.1" 200 None
2026-03-29 10:46:06 [auto1.de] INFO: Scrape type for YZ02891: 0
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: TR29242
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: EH74831
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: BN99160
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: ZK28238
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: XE05980
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: KY14800
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY14800%27 HTTP/1.1" 200 None
2026-03-29 10:46:06 [auto1.de] INFO: Scrape type for KY14800: 0
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: NB05774
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: NM28513
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: LV90463
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV90463%27 HTTP/1.1" 200 None
2026-03-29 10:46:06 [auto1.de] INFO: Scrape type for LV90463: 0
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: ND58698
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: XL60244
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL60244%27 HTTP/1.1" 200 None
2026-03-29 10:46:06 [auto1.de] INFO: Scrape type for XL60244: 0
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: SX16558
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX16558%27 HTTP/1.1" 200 None
2026-03-29 10:46:06 [auto1.de] INFO: Scrape type for SX16558: 0
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: FZ45055
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ45055%27 HTTP/1.1" 200 None
2026-03-29 10:46:06 [auto1.de] INFO: Scrape type for FZ45055: 0
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: TE33138
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE33138%27 HTTP/1.1" 200 None
2026-03-29 10:46:06 [auto1.de] INFO: Scrape type for TE33138: 0
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: XB85812
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB85812%27 HTTP/1.1" 200 None
2026-03-29 10:46:06 [auto1.de] INFO: Scrape type for XB85812: 0
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: YM60509
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: HA69467
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: EA13561
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: XK59182
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: JL71783
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL71783%27 HTTP/1.1" 200 None
2026-03-29 10:46:06 [auto1.de] INFO: Scrape type for JL71783: 0
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: SG91001
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: AZ50044
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ50044%27 HTTP/1.1" 200 None
2026-03-29 10:46:06 [auto1.de] INFO: Scrape type for AZ50044: 0
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: UL30875
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: DX61886
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: GT00768
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: WZ21973
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ21973%27 HTTP/1.1" 200 None
2026-03-29 10:46:06 [auto1.de] INFO: Scrape type for WZ21973: 0
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: CF91602
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF91602%27 HTTP/1.1" 200 None
2026-03-29 10:46:06 [auto1.de] INFO: Scrape type for CF91602: 0
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: MR38870
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: CS24568
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS24568%27 HTTP/1.1" 200 None
2026-03-29 10:46:06 [auto1.de] INFO: Scrape type for CS24568: 0
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: ZN01973
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: YS21206
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: NW97614
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW97614%27 HTTP/1.1" 200 None
2026-03-29 10:46:06 [auto1.de] INFO: Scrape type for NW97614: 0
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: LD79531
2026-03-29 10:46:06 [auto1.de] INFO: Found listing with ID: YT11339
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT11339%27 HTTP/1.1" 200 None
2026-03-29 10:46:06 [auto1.de] INFO: Scrape type for YT11339: 0
2026-03-29 10:46:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:46:06 [scrapy.extensions.logstats] INFO: Crawled 199 pages (at 7 pages/min), scraped 261 items (at 2 items/min)
2026-03-29 10:46:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 160MiB
2026-03-29 10:46:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:46:11 [auto1.de] INFO: Channel: 24h | Page: 138 | totalHits: 6726 | hits on page: 40
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: YY92615
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY92615%27 HTTP/1.1" 200 None
2026-03-29 10:46:11 [auto1.de] INFO: Scrape type for YY92615: 0
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: VY67119
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: ML67017
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML67017%27 HTTP/1.1" 200 None
2026-03-29 10:46:11 [auto1.de] INFO: Scrape type for ML67017: 0
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: SS86318
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS86318%27 HTTP/1.1" 200 None
2026-03-29 10:46:11 [auto1.de] INFO: Scrape type for SS86318: 0
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: LS92843
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS92843%27 HTTP/1.1" 200 None
2026-03-29 10:46:11 [auto1.de] INFO: Scrape type for LS92843: 0
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: UX52309
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: XS74936
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: LD63966
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: PT52067
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: MH24339
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: PB28144
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB28144%27 HTTP/1.1" 200 None
2026-03-29 10:46:11 [auto1.de] INFO: Scrape type for PB28144: 0
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: AD21201
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD21201%27 HTTP/1.1" 200 None
2026-03-29 10:46:11 [auto1.de] INFO: Scrape type for AD21201: 0
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: PX71275
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: RG95107
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG95107%27 HTTP/1.1" 200 None
2026-03-29 10:46:11 [auto1.de] INFO: Scrape type for RG95107: 0
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: SV60739
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV60739%27 HTTP/1.1" 200 None
2026-03-29 10:46:11 [auto1.de] INFO: Scrape type for SV60739: 0
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: FH60355
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH60355%27 HTTP/1.1" 200 None
2026-03-29 10:46:11 [auto1.de] INFO: Scrape type for FH60355: 0
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: UB59521
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB59521%27 HTTP/1.1" 200 None
2026-03-29 10:46:11 [auto1.de] INFO: Scrape type for UB59521: 0
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: KW39556
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW39556%27 HTTP/1.1" 200 None
2026-03-29 10:46:11 [auto1.de] INFO: Scrape type for KW39556: 0
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: ZD67638
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD67638%27 HTTP/1.1" 200 None
2026-03-29 10:46:11 [auto1.de] INFO: Scrape type for ZD67638: 0
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: RZ07739
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ07739%27 HTTP/1.1" 200 None
2026-03-29 10:46:11 [auto1.de] INFO: Scrape type for RZ07739: 0
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: TV17454
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: EC44311
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: BD92511
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD92511%27 HTTP/1.1" 200 None
2026-03-29 10:46:11 [auto1.de] INFO: Scrape type for BD92511: 0
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: GT58505
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT58505%27 HTTP/1.1" 200 None
2026-03-29 10:46:11 [auto1.de] INFO: Scrape type for GT58505: 0
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: EL23730
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL23730%27 HTTP/1.1" 200 None
2026-03-29 10:46:11 [auto1.de] INFO: Scrape type for EL23730: 0
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: TX33214
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX33214%27 HTTP/1.1" 200 None
2026-03-29 10:46:11 [auto1.de] INFO: Scrape type for TX33214: 0
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: CJ94447
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ94447%27 HTTP/1.1" 200 None
2026-03-29 10:46:11 [auto1.de] INFO: Scrape type for CJ94447: 0
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: KW65379
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW65379%27 HTTP/1.1" 200 None
2026-03-29 10:46:11 [auto1.de] INFO: Scrape type for KW65379: 0
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: UV35373
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV35373%27 HTTP/1.1" 200 None
2026-03-29 10:46:11 [auto1.de] INFO: Scrape type for UV35373: 0
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: ED19748
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: LG11243
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: BP44038
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: GJ71101
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: AB49272
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: EE25450
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE25450%27 HTTP/1.1" 200 None
2026-03-29 10:46:11 [auto1.de] INFO: Scrape type for EE25450: 2
2026-03-29 10:46:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce31b62f-8942-54ce-8a06-f809b686ca47 with identifier: EE25450
2026-03-29 10:46:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce31b62f-8942-54ce-8a06-f809b686ca47 with scrape type 2
2026-03-29 10:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce31b62f-8942-54ce-8a06-f809b686ca47 with scrape type 2
2026-03-29 10:46:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce31b62f-8942-54ce-8a06-f809b686ca47, identifier: EE25450
2026-03-29 10:46:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce31b62f-8942-54ce-8a06-f809b686ca47 with identifier: EE25450
2026-03-29 10:46:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce31b62f-8942-54ce-8a06-f809b686ca47 with identifier: EE25450
2026-03-29 10:46:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce31b62f-8942-54ce-8a06-f809b686ca47 with identifier: EE25450 to the API
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:46:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:34:06Z',
 'fuel_type': 'diesel',
 'id': 'ce31b62f-8942-54ce-8a06-f809b686ca47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE25450',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 207585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-22',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Style BlueMotion',
 'transmission': 'manual',
 'trim': 'Style BlueMotion',
 'year': 2012}
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE25450%27 HTTP/1.1" 200 None
2026-03-29 10:46:11 [auto1.de] INFO: Saving data for EE25450: {'auction_closing_time': 1774884846.0, 'created_time': 1774031844.534341, 'last_price_update_time': 1774781171.861504}
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE25450') HTTP/1.1" 204 0
2026-03-29 10:46:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: UC35648
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC35648%27 HTTP/1.1" 200 None
2026-03-29 10:46:11 [auto1.de] INFO: Scrape type for UC35648: 0
2026-03-29 10:46:11 [auto1.de] INFO: Found listing with ID: TT34897
2026-03-29 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT34897%27 HTTP/1.1" 200 None
2026-03-29 10:46:12 [auto1.de] INFO: Scrape type for TT34897: 0
2026-03-29 10:46:12 [auto1.de] INFO: Found listing with ID: KU38253
2026-03-29 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU38253%27 HTTP/1.1" 200 None
2026-03-29 10:46:12 [auto1.de] INFO: Scrape type for KU38253: 0
2026-03-29 10:46:12 [auto1.de] INFO: Found listing with ID: NG37948
2026-03-29 10:46:12 [auto1.de] INFO: Found listing with ID: GW03247
2026-03-29 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW03247%27 HTTP/1.1" 200 None
2026-03-29 10:46:12 [auto1.de] INFO: Scrape type for GW03247: 0
2026-03-29 10:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:46:12 [auto1.de] INFO: Channel: 24h | Page: 139 | totalHits: 6726 | hits on page: 40
2026-03-29 10:46:12 [auto1.de] INFO: Found listing with ID: WP81367
2026-03-29 10:46:12 [auto1.de] INFO: Found listing with ID: GS33010
2026-03-29 10:46:12 [auto1.de] INFO: Found listing with ID: UA95146
2026-03-29 10:46:12 [auto1.de] INFO: Found listing with ID: GG27070
2026-03-29 10:46:12 [auto1.de] INFO: Found listing with ID: RC84625
2026-03-29 10:46:12 [auto1.de] INFO: Found listing with ID: TN24608
2026-03-29 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN24608%27 HTTP/1.1" 200 None
2026-03-29 10:46:12 [auto1.de] INFO: Scrape type for TN24608: 0
2026-03-29 10:46:12 [auto1.de] INFO: Found listing with ID: VF40931
2026-03-29 10:46:12 [auto1.de] INFO: Found listing with ID: PB99961
2026-03-29 10:46:12 [auto1.de] INFO: Found listing with ID: HD35365
2026-03-29 10:46:12 [auto1.de] INFO: Found listing with ID: VS86742
2026-03-29 10:46:12 [auto1.de] INFO: Found listing with ID: TB14981
2026-03-29 10:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB14981%27 HTTP/1.1" 200 None
2026-03-29 10:46:13 [auto1.de] INFO: Scrape type for TB14981: 0
2026-03-29 10:46:13 [auto1.de] INFO: Found listing with ID: GC05156
2026-03-29 10:46:13 [auto1.de] INFO: Found listing with ID: HS66521
2026-03-29 10:46:13 [auto1.de] INFO: Found listing with ID: YT67181
2026-03-29 10:46:13 [auto1.de] INFO: Found listing with ID: WC36574
2026-03-29 10:46:13 [auto1.de] INFO: Found listing with ID: CU13937
2026-03-29 10:46:13 [auto1.de] INFO: Found listing with ID: ER30285
2026-03-29 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER30285%27 HTTP/1.1" 200 None
2026-03-29 10:46:13 [auto1.de] INFO: Scrape type for ER30285: 0
2026-03-29 10:46:13 [auto1.de] INFO: Found listing with ID: KS41473
2026-03-29 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS41473%27 HTTP/1.1" 200 None
2026-03-29 10:46:13 [auto1.de] INFO: Scrape type for KS41473: 0
2026-03-29 10:46:13 [auto1.de] INFO: Found listing with ID: MJ96775
2026-03-29 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ96775%27 HTTP/1.1" 200 None
2026-03-29 10:46:13 [auto1.de] INFO: Scrape type for MJ96775: 0
2026-03-29 10:46:13 [auto1.de] INFO: Found listing with ID: GL30880
2026-03-29 10:46:13 [auto1.de] INFO: Found listing with ID: NU47228
2026-03-29 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU47228%27 HTTP/1.1" 200 None
2026-03-29 10:46:13 [auto1.de] INFO: Scrape type for NU47228: 0
2026-03-29 10:46:13 [auto1.de] INFO: Found listing with ID: ZF63164
2026-03-29 10:46:13 [auto1.de] INFO: Found listing with ID: LB77280
2026-03-29 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB77280%27 HTTP/1.1" 200 None
2026-03-29 10:46:13 [auto1.de] INFO: Scrape type for LB77280: 0
2026-03-29 10:46:13 [auto1.de] INFO: Found listing with ID: PU26229
2026-03-29 10:46:13 [auto1.de] INFO: Found listing with ID: EA40469
2026-03-29 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA40469%27 HTTP/1.1" 200 None
2026-03-29 10:46:13 [auto1.de] INFO: Scrape type for EA40469: 0
2026-03-29 10:46:13 [auto1.de] INFO: Found listing with ID: SR33990
2026-03-29 10:46:13 [auto1.de] INFO: Found listing with ID: NX83651
2026-03-29 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX83651%27 HTTP/1.1" 200 None
2026-03-29 10:46:13 [auto1.de] INFO: Scrape type for NX83651: 0
2026-03-29 10:46:13 [auto1.de] INFO: Found listing with ID: NF13899
2026-03-29 10:46:13 [auto1.de] INFO: Found listing with ID: GM00936
2026-03-29 10:46:13 [auto1.de] INFO: Found listing with ID: ET23804
2026-03-29 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET23804%27 HTTP/1.1" 200 None
2026-03-29 10:46:13 [auto1.de] INFO: Scrape type for ET23804: 0
2026-03-29 10:46:13 [auto1.de] INFO: Found listing with ID: FZ16195
2026-03-29 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ16195%27 HTTP/1.1" 200 None
2026-03-29 10:46:13 [auto1.de] INFO: Scrape type for FZ16195: 0
2026-03-29 10:46:13 [auto1.de] INFO: Found listing with ID: MA09266
2026-03-29 10:46:13 [auto1.de] INFO: Found listing with ID: RW93776
2026-03-29 10:46:13 [auto1.de] INFO: Found listing with ID: SD88360
2026-03-29 10:46:13 [auto1.de] INFO: Found listing with ID: SS79198
2026-03-29 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS79198%27 HTTP/1.1" 200 None
2026-03-29 10:46:13 [auto1.de] INFO: Scrape type for SS79198: 0
2026-03-29 10:46:13 [auto1.de] INFO: Found listing with ID: EK21596
2026-03-29 10:46:13 [auto1.de] INFO: Found listing with ID: TL42173
2026-03-29 10:46:13 [auto1.de] INFO: Found listing with ID: EC36203
2026-03-29 10:46:13 [auto1.de] INFO: Found listing with ID: NP30819
2026-03-29 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP30819%27 HTTP/1.1" 200 None
2026-03-29 10:46:13 [auto1.de] INFO: Scrape type for NP30819: 0
2026-03-29 10:46:13 [auto1.de] INFO: Found listing with ID: WK96887
2026-03-29 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK96887%27 HTTP/1.1" 200 None
2026-03-29 10:46:13 [auto1.de] INFO: Scrape type for WK96887: 0
2026-03-29 10:46:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:46:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:46:14 [auto1.de] INFO: Channel: 24h | Page: 140 | totalHits: 6726 | hits on page: 40
2026-03-29 10:46:14 [auto1.de] INFO: Found listing with ID: PU13127
2026-03-29 10:46:14 [auto1.de] INFO: Found listing with ID: XX31179
2026-03-29 10:46:14 [auto1.de] INFO: Found listing with ID: DF28851
2026-03-29 10:46:14 [auto1.de] INFO: Found listing with ID: UT28734
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT28734%27 HTTP/1.1" 200 None
2026-03-29 10:46:14 [auto1.de] INFO: Scrape type for UT28734: 0
2026-03-29 10:46:14 [auto1.de] INFO: Found listing with ID: UC83378
2026-03-29 10:46:14 [auto1.de] INFO: Found listing with ID: JH61376
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH61376%27 HTTP/1.1" 200 None
2026-03-29 10:46:14 [auto1.de] INFO: Scrape type for JH61376: 0
2026-03-29 10:46:14 [auto1.de] INFO: Found listing with ID: SD45668
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD45668%27 HTTP/1.1" 200 None
2026-03-29 10:46:14 [auto1.de] INFO: Scrape type for SD45668: 0
2026-03-29 10:46:14 [auto1.de] INFO: Found listing with ID: KK39591
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK39591%27 HTTP/1.1" 200 None
2026-03-29 10:46:14 [auto1.de] INFO: Scrape type for KK39591: 2
2026-03-29 10:46:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f463eca-7c88-5191-8bae-76d29a9d5b8d with identifier: KK39591
2026-03-29 10:46:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f463eca-7c88-5191-8bae-76d29a9d5b8d with scrape type 2
2026-03-29 10:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f463eca-7c88-5191-8bae-76d29a9d5b8d with scrape type 2
2026-03-29 10:46:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f463eca-7c88-5191-8bae-76d29a9d5b8d, identifier: KK39591
2026-03-29 10:46:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f463eca-7c88-5191-8bae-76d29a9d5b8d with identifier: KK39591
2026-03-29 10:46:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f463eca-7c88-5191-8bae-76d29a9d5b8d with identifier: KK39591
2026-03-29 10:46:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f463eca-7c88-5191-8bae-76d29a9d5b8d with identifier: KK39591 to the API
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:46:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:28:05Z',
 'fuel_type': 'petrol',
 'id': '6f463eca-7c88-5191-8bae-76d29a9d5b8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK39591',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 57524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-21',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 BlueEfficiency Urban',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Urban',
 'year': 2013}
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK39591%27 HTTP/1.1" 200 None
2026-03-29 10:46:14 [auto1.de] INFO: Saving data for KK39591: {'auction_closing_time': 1774884485.0, 'created_time': 1774596933.424869, 'last_price_update_time': 1774781174.683353}
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KK39591') HTTP/1.1" 204 0
2026-03-29 10:46:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:46:14 [auto1.de] INFO: Found listing with ID: MW22662
2026-03-29 10:46:14 [auto1.de] INFO: Found listing with ID: LU75285
2026-03-29 10:46:14 [auto1.de] INFO: Found listing with ID: FP92588
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP92588%27 HTTP/1.1" 200 None
2026-03-29 10:46:14 [auto1.de] INFO: Scrape type for FP92588: 0
2026-03-29 10:46:14 [auto1.de] INFO: Found listing with ID: CF68220
2026-03-29 10:46:14 [auto1.de] INFO: Found listing with ID: ZA74026
2026-03-29 10:46:14 [auto1.de] INFO: Found listing with ID: KH38301
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH38301%27 HTTP/1.1" 200 None
2026-03-29 10:46:14 [auto1.de] INFO: Scrape type for KH38301: 0
2026-03-29 10:46:14 [auto1.de] INFO: Found listing with ID: XV47877
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV47877%27 HTTP/1.1" 200 None
2026-03-29 10:46:14 [auto1.de] INFO: Scrape type for XV47877: 0
2026-03-29 10:46:14 [auto1.de] INFO: Found listing with ID: GC30737
2026-03-29 10:46:14 [auto1.de] INFO: Found listing with ID: SP00408
2026-03-29 10:46:14 [auto1.de] INFO: Found listing with ID: XF17671
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF17671%27 HTTP/1.1" 200 None
2026-03-29 10:46:14 [auto1.de] INFO: Scrape type for XF17671: 0
2026-03-29 10:46:14 [auto1.de] INFO: Found listing with ID: EC58383
2026-03-29 10:46:14 [auto1.de] INFO: Found listing with ID: ZT05209
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT05209%27 HTTP/1.1" 200 None
2026-03-29 10:46:14 [auto1.de] INFO: Scrape type for ZT05209: 0
2026-03-29 10:46:14 [auto1.de] INFO: Found listing with ID: GB76211
2026-03-29 10:46:14 [auto1.de] INFO: Found listing with ID: VE08810
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE08810%27 HTTP/1.1" 200 None
2026-03-29 10:46:14 [auto1.de] INFO: Scrape type for VE08810: 0
2026-03-29 10:46:14 [auto1.de] INFO: Found listing with ID: NB45839
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB45839%27 HTTP/1.1" 200 None
2026-03-29 10:46:14 [auto1.de] INFO: Scrape type for NB45839: 0
2026-03-29 10:46:14 [auto1.de] INFO: Found listing with ID: BD21444
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD21444%27 HTTP/1.1" 200 None
2026-03-29 10:46:14 [auto1.de] INFO: Scrape type for BD21444: 0
2026-03-29 10:46:14 [auto1.de] INFO: Found listing with ID: HL77146
2026-03-29 10:46:14 [auto1.de] INFO: Found listing with ID: WH58707
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH58707%27 HTTP/1.1" 200 None
2026-03-29 10:46:14 [auto1.de] INFO: Scrape type for WH58707: 0
2026-03-29 10:46:14 [auto1.de] INFO: Found listing with ID: XR58128
2026-03-29 10:46:14 [auto1.de] INFO: Found listing with ID: TM06695
2026-03-29 10:46:14 [auto1.de] INFO: Found listing with ID: DP78752
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP78752%27 HTTP/1.1" 200 None
2026-03-29 10:46:14 [auto1.de] INFO: Scrape type for DP78752: 0
2026-03-29 10:46:14 [auto1.de] INFO: Found listing with ID: XW71594
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW71594%27 HTTP/1.1" 200 None
2026-03-29 10:46:14 [auto1.de] INFO: Scrape type for XW71594: 0
2026-03-29 10:46:14 [auto1.de] INFO: Found listing with ID: PZ33404
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ33404%27 HTTP/1.1" 200 None
2026-03-29 10:46:14 [auto1.de] INFO: Scrape type for PZ33404: 0
2026-03-29 10:46:14 [auto1.de] INFO: Found listing with ID: ST45837
2026-03-29 10:46:14 [auto1.de] INFO: Found listing with ID: VT41344
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT41344%27 HTTP/1.1" 200 None
2026-03-29 10:46:14 [auto1.de] INFO: Scrape type for VT41344: 0
2026-03-29 10:46:14 [auto1.de] INFO: Found listing with ID: MK98498
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK98498%27 HTTP/1.1" 200 None
2026-03-29 10:46:14 [auto1.de] INFO: Scrape type for MK98498: 0
2026-03-29 10:46:14 [auto1.de] INFO: Found listing with ID: FH98757
2026-03-29 10:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH98757%27 HTTP/1.1" 200 None
2026-03-29 10:46:15 [auto1.de] INFO: Scrape type for FH98757: 0
2026-03-29 10:46:15 [auto1.de] INFO: Found listing with ID: JU26227
2026-03-29 10:46:15 [auto1.de] INFO: Found listing with ID: YA68492
2026-03-29 10:46:15 [auto1.de] INFO: Found listing with ID: MU44330
2026-03-29 10:46:15 [auto1.de] INFO: Found listing with ID: GV67460
2026-03-29 10:46:15 [auto1.de] INFO: Found listing with ID: NZ17394
2026-03-29 10:46:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:46:16 [auto1.de] INFO: Channel: 24h | Page: 141 | totalHits: 6726 | hits on page: 40
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: CV09356
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV09356%27 HTTP/1.1" 200 None
2026-03-29 10:46:16 [auto1.de] INFO: Scrape type for CV09356: 0
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: AC92366
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC92366%27 HTTP/1.1" 200 None
2026-03-29 10:46:16 [auto1.de] INFO: Scrape type for AC92366: 0
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: GH92253
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: VT94173
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: MY90175
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: NH48980
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: PW96816
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW96816%27 HTTP/1.1" 200 None
2026-03-29 10:46:16 [auto1.de] INFO: Scrape type for PW96816: 0
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: UZ14919
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: JU61936
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU61936%27 HTTP/1.1" 200 None
2026-03-29 10:46:16 [auto1.de] INFO: Scrape type for JU61936: 0
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: KC56991
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: FY38947
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY38947%27 HTTP/1.1" 200 None
2026-03-29 10:46:16 [auto1.de] INFO: Scrape type for FY38947: 0
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: MU41228
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU41228%27 HTTP/1.1" 200 None
2026-03-29 10:46:16 [auto1.de] INFO: Scrape type for MU41228: 0
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: NG13141
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG13141%27 HTTP/1.1" 200 None
2026-03-29 10:46:16 [auto1.de] INFO: Scrape type for NG13141: 0
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: SP37211
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: BP15722
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP15722%27 HTTP/1.1" 200 None
2026-03-29 10:46:16 [auto1.de] INFO: Scrape type for BP15722: 0
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: ZJ20785
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: PG70940
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG70940%27 HTTP/1.1" 200 None
2026-03-29 10:46:16 [auto1.de] INFO: Scrape type for PG70940: 0
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: HJ15324
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: YJ96267
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ96267%27 HTTP/1.1" 200 None
2026-03-29 10:46:16 [auto1.de] INFO: Scrape type for YJ96267: 0
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: BH45975
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH45975%27 HTTP/1.1" 200 None
2026-03-29 10:46:16 [auto1.de] INFO: Scrape type for BH45975: 0
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: JS30878
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS30878%27 HTTP/1.1" 200 None
2026-03-29 10:46:16 [auto1.de] INFO: Scrape type for JS30878: 0
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: NL79635
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: LF10236
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF10236%27 HTTP/1.1" 200 None
2026-03-29 10:46:16 [auto1.de] INFO: Scrape type for LF10236: 0
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: DP76469
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: ST53597
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST53597%27 HTTP/1.1" 200 None
2026-03-29 10:46:16 [auto1.de] INFO: Scrape type for ST53597: 0
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: AD05986
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD05986%27 HTTP/1.1" 200 None
2026-03-29 10:46:16 [auto1.de] INFO: Scrape type for AD05986: 0
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: LU20114
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: WT09019
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT09019%27 HTTP/1.1" 200 None
2026-03-29 10:46:16 [auto1.de] INFO: Scrape type for WT09019: 0
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: MA38279
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: PZ30496
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: CH12661
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: HC35889
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: AX97123
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX97123%27 HTTP/1.1" 200 None
2026-03-29 10:46:16 [auto1.de] INFO: Scrape type for AX97123: 0
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: ZM69821
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: ZW92608
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW92608%27 HTTP/1.1" 200 None
2026-03-29 10:46:16 [auto1.de] INFO: Scrape type for ZW92608: 0
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: KF80964
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: CE00984
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE00984%27 HTTP/1.1" 200 None
2026-03-29 10:46:16 [auto1.de] INFO: Scrape type for CE00984: 0
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: KR40526
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: NS83554
2026-03-29 10:46:16 [auto1.de] INFO: Found listing with ID: UV09635
2026-03-29 10:46:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:46:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:46:29 [auto1.de] INFO: Channel: 24h | Page: 142 | totalHits: 6726 | hits on page: 40
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: CS70589
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS70589%27 HTTP/1.1" 200 None
2026-03-29 10:46:29 [auto1.de] INFO: Scrape type for CS70589: 0
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: MK47455
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK47455%27 HTTP/1.1" 200 None
2026-03-29 10:46:29 [auto1.de] INFO: Scrape type for MK47455: 0
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: ND12794
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND12794%27 HTTP/1.1" 200 None
2026-03-29 10:46:29 [auto1.de] INFO: Scrape type for ND12794: 0
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: TW63260
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW63260%27 HTTP/1.1" 200 None
2026-03-29 10:46:29 [auto1.de] INFO: Scrape type for TW63260: 0
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: SE34706
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE34706%27 HTTP/1.1" 200 None
2026-03-29 10:46:29 [auto1.de] INFO: Scrape type for SE34706: 0
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: LR83897
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: EX09851
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: RT47788
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: NM77711
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM77711%27 HTTP/1.1" 200 None
2026-03-29 10:46:29 [auto1.de] INFO: Scrape type for NM77711: 0
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: NF65308
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: SM15553
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM15553%27 HTTP/1.1" 200 None
2026-03-29 10:46:29 [auto1.de] INFO: Scrape type for SM15553: 0
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: RB21288
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: TL00985
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: WM78340
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM78340%27 HTTP/1.1" 200 None
2026-03-29 10:46:29 [auto1.de] INFO: Scrape type for WM78340: 0
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: NF79967
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF79967%27 HTTP/1.1" 200 None
2026-03-29 10:46:29 [auto1.de] INFO: Scrape type for NF79967: 0
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: BP86172
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP86172%27 HTTP/1.1" 200 None
2026-03-29 10:46:29 [auto1.de] INFO: Scrape type for BP86172: 0
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: SM64754
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: PL66942
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: LR99893
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR99893%27 HTTP/1.1" 200 None
2026-03-29 10:46:29 [auto1.de] INFO: Scrape type for LR99893: 0
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: VG16481
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG16481%27 HTTP/1.1" 200 None
2026-03-29 10:46:29 [auto1.de] INFO: Scrape type for VG16481: 0
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: RU39212
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: PH19268
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH19268%27 HTTP/1.1" 200 None
2026-03-29 10:46:29 [auto1.de] INFO: Scrape type for PH19268: 0
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: ZS99681
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: PU80535
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU80535%27 HTTP/1.1" 200 None
2026-03-29 10:46:29 [auto1.de] INFO: Scrape type for PU80535: 0
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: AN91174
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN91174%27 HTTP/1.1" 200 None
2026-03-29 10:46:29 [auto1.de] INFO: Scrape type for AN91174: 0
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: AF19813
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF19813%27 HTTP/1.1" 200 None
2026-03-29 10:46:29 [auto1.de] INFO: Scrape type for AF19813: 0
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: DK08847
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK08847%27 HTTP/1.1" 200 None
2026-03-29 10:46:29 [auto1.de] INFO: Scrape type for DK08847: 0
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: JB87569
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB87569%27 HTTP/1.1" 200 None
2026-03-29 10:46:29 [auto1.de] INFO: Scrape type for JB87569: 0
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: EE75447
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: RP15985
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: TA77613
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA77613%27 HTTP/1.1" 200 None
2026-03-29 10:46:29 [auto1.de] INFO: Scrape type for TA77613: 0
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: SP96955
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: DW77268
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW77268%27 HTTP/1.1" 200 None
2026-03-29 10:46:29 [auto1.de] INFO: Scrape type for DW77268: 0
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: DJ18232
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ18232%27 HTTP/1.1" 200 None
2026-03-29 10:46:29 [auto1.de] INFO: Scrape type for DJ18232: 0
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: RL54518
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL54518%27 HTTP/1.1" 200 None
2026-03-29 10:46:29 [auto1.de] INFO: Scrape type for RL54518: 0
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: GS31332
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: GS03100
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS03100%27 HTTP/1.1" 200 None
2026-03-29 10:46:29 [auto1.de] INFO: Scrape type for GS03100: 0
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: FC21553
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC21553%27 HTTP/1.1" 200 None
2026-03-29 10:46:29 [auto1.de] INFO: Scrape type for FC21553: 0
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: CT45397
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT45397%27 HTTP/1.1" 200 None
2026-03-29 10:46:29 [auto1.de] INFO: Scrape type for CT45397: 0
2026-03-29 10:46:29 [auto1.de] INFO: Found listing with ID: TH39634
2026-03-29 10:46:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:46:30 [auto1.de] INFO: Channel: 24h | Page: 143 | totalHits: 6726 | hits on page: 40
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: MY94359
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: FZ92426
2026-03-29 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ92426%27 HTTP/1.1" 200 None
2026-03-29 10:46:30 [auto1.de] INFO: Scrape type for FZ92426: 0
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: RE77380
2026-03-29 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE77380%27 HTTP/1.1" 200 None
2026-03-29 10:46:30 [auto1.de] INFO: Scrape type for RE77380: 0
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: ZS85048
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: ZY92659
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: DK37949
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: ZY32657
2026-03-29 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY32657%27 HTTP/1.1" 200 None
2026-03-29 10:46:30 [auto1.de] INFO: Scrape type for ZY32657: 0
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: RF12873
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: WK31693
2026-03-29 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK31693%27 HTTP/1.1" 200 None
2026-03-29 10:46:30 [auto1.de] INFO: Scrape type for WK31693: 0
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: WL69602
2026-03-29 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL69602%27 HTTP/1.1" 200 None
2026-03-29 10:46:30 [auto1.de] INFO: Scrape type for WL69602: 0
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: XR35811
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: NC71734
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: XU03488
2026-03-29 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU03488%27 HTTP/1.1" 200 None
2026-03-29 10:46:30 [auto1.de] INFO: Scrape type for XU03488: 0
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: JN07474
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: CT96582
2026-03-29 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT96582%27 HTTP/1.1" 200 None
2026-03-29 10:46:30 [auto1.de] INFO: Scrape type for CT96582: 0
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: XZ21442
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: EK71515
2026-03-29 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK71515%27 HTTP/1.1" 200 None
2026-03-29 10:46:30 [auto1.de] INFO: Scrape type for EK71515: 0
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: YE73742
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: CA87699
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: XU33519
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: HK31829
2026-03-29 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK31829%27 HTTP/1.1" 200 None
2026-03-29 10:46:30 [auto1.de] INFO: Scrape type for HK31829: 0
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: NK26673
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: XD40949
2026-03-29 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD40949%27 HTTP/1.1" 200 None
2026-03-29 10:46:30 [auto1.de] INFO: Scrape type for XD40949: 0
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: NM76791
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: HA62575
2026-03-29 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA62575%27 HTTP/1.1" 200 None
2026-03-29 10:46:30 [auto1.de] INFO: Scrape type for HA62575: 0
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: AU44008
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: UN89180
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: YH18669
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: EL96080
2026-03-29 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL96080%27 HTTP/1.1" 200 None
2026-03-29 10:46:30 [auto1.de] INFO: Scrape type for EL96080: 0
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: KD63113
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: FL46038
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: NX82618
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: ZD28041
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: LK56613
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: DS29172
2026-03-29 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS29172%27 HTTP/1.1" 200 None
2026-03-29 10:46:30 [auto1.de] INFO: Scrape type for DS29172: 0
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: WE31393
2026-03-29 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE31393%27 HTTP/1.1" 200 None
2026-03-29 10:46:30 [auto1.de] INFO: Scrape type for WE31393: 0
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: CC29120
2026-03-29 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC29120%27 HTTP/1.1" 200 None
2026-03-29 10:46:30 [auto1.de] INFO: Scrape type for CC29120: 0
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: FT90380
2026-03-29 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT90380%27 HTTP/1.1" 200 None
2026-03-29 10:46:30 [auto1.de] INFO: Scrape type for FT90380: 0
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: SA04539
2026-03-29 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA04539%27 HTTP/1.1" 200 None
2026-03-29 10:46:30 [auto1.de] INFO: Scrape type for SA04539: 0
2026-03-29 10:46:30 [auto1.de] INFO: Found listing with ID: KV17598
2026-03-29 10:46:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:46:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:46:31 [auto1.de] INFO: Channel: 24h | Page: 144 | totalHits: 6726 | hits on page: 40
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: TV41751
2026-03-29 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV41751%27 HTTP/1.1" 200 None
2026-03-29 10:46:31 [auto1.de] INFO: Scrape type for TV41751: 0
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: HX78633
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: TE40935
2026-03-29 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE40935%27 HTTP/1.1" 200 None
2026-03-29 10:46:31 [auto1.de] INFO: Scrape type for TE40935: 0
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: GY13468
2026-03-29 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY13468%27 HTTP/1.1" 200 None
2026-03-29 10:46:31 [auto1.de] INFO: Scrape type for GY13468: 0
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: GY83312
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: BG42804
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: GM83626
2026-03-29 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM83626%27 HTTP/1.1" 200 None
2026-03-29 10:46:31 [auto1.de] INFO: Scrape type for GM83626: 0
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: HG43188
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: CW85183
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: NP47731
2026-03-29 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP47731%27 HTTP/1.1" 200 None
2026-03-29 10:46:31 [auto1.de] INFO: Scrape type for NP47731: 0
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: KV68719
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: JP17422
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: GJ18953
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: GR83992
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: JJ86463
2026-03-29 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ86463%27 HTTP/1.1" 200 None
2026-03-29 10:46:31 [auto1.de] INFO: Scrape type for JJ86463: 0
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: BV89454
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: MX21840
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: DR45963
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: UB44378
2026-03-29 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB44378%27 HTTP/1.1" 200 None
2026-03-29 10:46:31 [auto1.de] INFO: Scrape type for UB44378: 0
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: CE18724
2026-03-29 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE18724%27 HTTP/1.1" 200 None
2026-03-29 10:46:31 [auto1.de] INFO: Scrape type for CE18724: 0
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: WN98696
2026-03-29 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN98696%27 HTTP/1.1" 200 None
2026-03-29 10:46:31 [auto1.de] INFO: Scrape type for WN98696: 0
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: RW68722
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: YD40390
2026-03-29 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD40390%27 HTTP/1.1" 200 None
2026-03-29 10:46:31 [auto1.de] INFO: Scrape type for YD40390: 0
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: AJ11888
2026-03-29 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ11888%27 HTTP/1.1" 200 None
2026-03-29 10:46:31 [auto1.de] INFO: Scrape type for AJ11888: 0
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: JX30830
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: EC85375
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: NN03303
2026-03-29 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN03303%27 HTTP/1.1" 200 None
2026-03-29 10:46:31 [auto1.de] INFO: Scrape type for NN03303: 0
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: VX97978
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: LB43778
2026-03-29 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB43778%27 HTTP/1.1" 200 None
2026-03-29 10:46:31 [auto1.de] INFO: Scrape type for LB43778: 0
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: ED69500
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: HC86157
2026-03-29 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC86157%27 HTTP/1.1" 200 None
2026-03-29 10:46:31 [auto1.de] INFO: Scrape type for HC86157: 0
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: AN99140
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: FD40697
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: UK28270
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: TM32674
2026-03-29 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM32674%27 HTTP/1.1" 200 None
2026-03-29 10:46:31 [auto1.de] INFO: Scrape type for TM32674: 0
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: UG29438
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: NY30954
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: NZ79152
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: HH84481
2026-03-29 10:46:31 [auto1.de] INFO: Found listing with ID: AJ75381
2026-03-29 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ75381%27 HTTP/1.1" 200 None
2026-03-29 10:46:31 [auto1.de] INFO: Scrape type for AJ75381: 0
2026-03-29 10:46:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:46:32 [auto1.de] INFO: Channel: 24h | Page: 145 | totalHits: 6726 | hits on page: 40
2026-03-29 10:46:32 [auto1.de] INFO: Found listing with ID: KA54911
2026-03-29 10:46:32 [auto1.de] INFO: Found listing with ID: TV53465
2026-03-29 10:46:32 [auto1.de] INFO: Found listing with ID: UP69379
2026-03-29 10:46:32 [auto1.de] INFO: Found listing with ID: TP61394
2026-03-29 10:46:32 [auto1.de] INFO: Found listing with ID: SG76993
2026-03-29 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG76993%27 HTTP/1.1" 200 None
2026-03-29 10:46:32 [auto1.de] INFO: Scrape type for SG76993: 0
2026-03-29 10:46:32 [auto1.de] INFO: Found listing with ID: EY95933
2026-03-29 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY95933%27 HTTP/1.1" 200 None
2026-03-29 10:46:32 [auto1.de] INFO: Scrape type for EY95933: 0
2026-03-29 10:46:32 [auto1.de] INFO: Found listing with ID: KR30537
2026-03-29 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR30537%27 HTTP/1.1" 200 None
2026-03-29 10:46:32 [auto1.de] INFO: Scrape type for KR30537: 0
2026-03-29 10:46:32 [auto1.de] INFO: Found listing with ID: BU21003
2026-03-29 10:46:32 [auto1.de] INFO: Found listing with ID: JY00372
2026-03-29 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY00372%27 HTTP/1.1" 200 None
2026-03-29 10:46:32 [auto1.de] INFO: Scrape type for JY00372: 0
2026-03-29 10:46:32 [auto1.de] INFO: Found listing with ID: CG91765
2026-03-29 10:46:32 [auto1.de] INFO: Found listing with ID: NG66001
2026-03-29 10:46:32 [auto1.de] INFO: Found listing with ID: BP09693
2026-03-29 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP09693%27 HTTP/1.1" 200 None
2026-03-29 10:46:32 [auto1.de] INFO: Scrape type for BP09693: 0
2026-03-29 10:46:32 [auto1.de] INFO: Found listing with ID: BT01554
2026-03-29 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT01554%27 HTTP/1.1" 200 None
2026-03-29 10:46:32 [auto1.de] INFO: Scrape type for BT01554: 0
2026-03-29 10:46:32 [auto1.de] INFO: Found listing with ID: MG61327
2026-03-29 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG61327%27 HTTP/1.1" 200 None
2026-03-29 10:46:32 [auto1.de] INFO: Scrape type for MG61327: 0
2026-03-29 10:46:32 [auto1.de] INFO: Found listing with ID: BM00053
2026-03-29 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM00053%27 HTTP/1.1" 200 None
2026-03-29 10:46:32 [auto1.de] INFO: Scrape type for BM00053: 0
2026-03-29 10:46:32 [auto1.de] INFO: Found listing with ID: MK22023
2026-03-29 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK22023%27 HTTP/1.1" 200 None
2026-03-29 10:46:32 [auto1.de] INFO: Scrape type for MK22023: 0
2026-03-29 10:46:32 [auto1.de] INFO: Found listing with ID: EA38947
2026-03-29 10:46:32 [auto1.de] INFO: Found listing with ID: BG08845
2026-03-29 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG08845%27 HTTP/1.1" 200 None
2026-03-29 10:46:32 [auto1.de] INFO: Scrape type for BG08845: 0
2026-03-29 10:46:32 [auto1.de] INFO: Found listing with ID: TR37501
2026-03-29 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR37501%27 HTTP/1.1" 200 None
2026-03-29 10:46:32 [auto1.de] INFO: Scrape type for TR37501: 0
2026-03-29 10:46:32 [auto1.de] INFO: Found listing with ID: UL05357
2026-03-29 10:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL05357%27 HTTP/1.1" 200 None
2026-03-29 10:46:33 [auto1.de] INFO: Scrape type for UL05357: 0
2026-03-29 10:46:33 [auto1.de] INFO: Found listing with ID: HZ69536
2026-03-29 10:46:33 [auto1.de] INFO: Found listing with ID: TK93923
2026-03-29 10:46:33 [auto1.de] INFO: Found listing with ID: LW29658
2026-03-29 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW29658%27 HTTP/1.1" 200 None
2026-03-29 10:46:33 [auto1.de] INFO: Scrape type for LW29658: 0
2026-03-29 10:46:33 [auto1.de] INFO: Found listing with ID: DV23135
2026-03-29 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV23135%27 HTTP/1.1" 200 None
2026-03-29 10:46:33 [auto1.de] INFO: Scrape type for DV23135: 0
2026-03-29 10:46:33 [auto1.de] INFO: Found listing with ID: VR46217
2026-03-29 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR46217%27 HTTP/1.1" 200 None
2026-03-29 10:46:33 [auto1.de] INFO: Scrape type for VR46217: 0
2026-03-29 10:46:33 [auto1.de] INFO: Found listing with ID: XH28612
2026-03-29 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH28612%27 HTTP/1.1" 200 None
2026-03-29 10:46:33 [auto1.de] INFO: Scrape type for XH28612: 0
2026-03-29 10:46:33 [auto1.de] INFO: Found listing with ID: KJ41571
2026-03-29 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ41571%27 HTTP/1.1" 200 None
2026-03-29 10:46:33 [auto1.de] INFO: Scrape type for KJ41571: 0
2026-03-29 10:46:33 [auto1.de] INFO: Found listing with ID: UD70348
2026-03-29 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD70348%27 HTTP/1.1" 200 None
2026-03-29 10:46:33 [auto1.de] INFO: Scrape type for UD70348: 0
2026-03-29 10:46:33 [auto1.de] INFO: Found listing with ID: CS73315
2026-03-29 10:46:33 [auto1.de] INFO: Found listing with ID: SE41978
2026-03-29 10:46:33 [auto1.de] INFO: Found listing with ID: NS35557
2026-03-29 10:46:33 [auto1.de] INFO: Found listing with ID: JJ64066
2026-03-29 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ64066%27 HTTP/1.1" 200 None
2026-03-29 10:46:33 [auto1.de] INFO: Scrape type for JJ64066: 0
2026-03-29 10:46:33 [auto1.de] INFO: Found listing with ID: MD22344
2026-03-29 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD22344%27 HTTP/1.1" 200 None
2026-03-29 10:46:33 [auto1.de] INFO: Scrape type for MD22344: 0
2026-03-29 10:46:33 [auto1.de] INFO: Found listing with ID: LW95470
2026-03-29 10:46:33 [auto1.de] INFO: Found listing with ID: GN95458
2026-03-29 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN95458%27 HTTP/1.1" 200 None
2026-03-29 10:46:33 [auto1.de] INFO: Scrape type for GN95458: 0
2026-03-29 10:46:33 [auto1.de] INFO: Found listing with ID: ZG18767
2026-03-29 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG18767%27 HTTP/1.1" 200 None
2026-03-29 10:46:33 [auto1.de] INFO: Scrape type for ZG18767: 0
2026-03-29 10:46:33 [auto1.de] INFO: Found listing with ID: GY54695
2026-03-29 10:46:33 [auto1.de] INFO: Found listing with ID: TM38106
2026-03-29 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM38106%27 HTTP/1.1" 200 None
2026-03-29 10:46:33 [auto1.de] INFO: Scrape type for TM38106: 0
2026-03-29 10:46:33 [auto1.de] INFO: Found listing with ID: TK68896
2026-03-29 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK68896%27 HTTP/1.1" 200 None
2026-03-29 10:46:33 [auto1.de] INFO: Scrape type for TK68896: 0
2026-03-29 10:46:33 [auto1.de] INFO: Found listing with ID: TV85934
2026-03-29 10:46:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:46:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:46:34 [auto1.de] INFO: Channel: 24h | Page: 146 | totalHits: 6726 | hits on page: 40
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: YN89436
2026-03-29 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN89436%27 HTTP/1.1" 200 None
2026-03-29 10:46:34 [auto1.de] INFO: Scrape type for YN89436: 0
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: YN15081
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: PR24120
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: WB47522
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: PM63573
2026-03-29 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM63573%27 HTTP/1.1" 200 None
2026-03-29 10:46:34 [auto1.de] INFO: Scrape type for PM63573: 0
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: JL46304
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: LL96634
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: HV52023
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: YT21216
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: YW86530
2026-03-29 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW86530%27 HTTP/1.1" 200 None
2026-03-29 10:46:34 [auto1.de] INFO: Scrape type for YW86530: 0
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: EH91304
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: WE57631
2026-03-29 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE57631%27 HTTP/1.1" 200 None
2026-03-29 10:46:34 [auto1.de] INFO: Scrape type for WE57631: 0
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: RR27166
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: SJ72548
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: XR20146
2026-03-29 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR20146%27 HTTP/1.1" 200 None
2026-03-29 10:46:34 [auto1.de] INFO: Scrape type for XR20146: 0
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: RL75454
2026-03-29 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL75454%27 HTTP/1.1" 200 None
2026-03-29 10:46:34 [auto1.de] INFO: Scrape type for RL75454: 0
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: SY42721
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: RM21545
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: UC78524
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: WG52031
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: RY75144
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: BX11542
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: FL40114
2026-03-29 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL40114%27 HTTP/1.1" 200 None
2026-03-29 10:46:34 [auto1.de] INFO: Scrape type for FL40114: 0
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: DN27813
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: HZ35402
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: WA51516
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: VY12832
2026-03-29 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY12832%27 HTTP/1.1" 200 None
2026-03-29 10:46:34 [auto1.de] INFO: Scrape type for VY12832: 0
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: GA49917
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: CC10989
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: FW05091
2026-03-29 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW05091%27 HTTP/1.1" 200 None
2026-03-29 10:46:34 [auto1.de] INFO: Scrape type for FW05091: 0
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: AZ02782
2026-03-29 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ02782%27 HTTP/1.1" 200 None
2026-03-29 10:46:34 [auto1.de] INFO: Scrape type for AZ02782: 0
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: MP53713
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: YA63127
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: YD24318
2026-03-29 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD24318%27 HTTP/1.1" 200 None
2026-03-29 10:46:34 [auto1.de] INFO: Scrape type for YD24318: 0
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: FZ76900
2026-03-29 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ76900%27 HTTP/1.1" 200 None
2026-03-29 10:46:34 [auto1.de] INFO: Scrape type for FZ76900: 0
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: PS79135
2026-03-29 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS79135%27 HTTP/1.1" 200 None
2026-03-29 10:46:34 [auto1.de] INFO: Scrape type for PS79135: 0
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: WK48382
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: AN23805
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: VL97674
2026-03-29 10:46:34 [auto1.de] INFO: Found listing with ID: UT78656
2026-03-29 10:46:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:46:35 [auto1.de] INFO: Channel: 24h | Page: 147 | totalHits: 6726 | hits on page: 40
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: JE05181
2026-03-29 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE05181%27 HTTP/1.1" 200 None
2026-03-29 10:46:35 [auto1.de] INFO: Scrape type for JE05181: 0
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: LZ68363
2026-03-29 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ68363%27 HTTP/1.1" 200 None
2026-03-29 10:46:35 [auto1.de] INFO: Scrape type for LZ68363: 0
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: RT81127
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: XL66615
2026-03-29 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL66615%27 HTTP/1.1" 200 None
2026-03-29 10:46:35 [auto1.de] INFO: Scrape type for XL66615: 0
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: KK21790
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: TV45930
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: DZ20117
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: BR60141
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: UA53111
2026-03-29 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA53111%27 HTTP/1.1" 200 None
2026-03-29 10:46:35 [auto1.de] INFO: Scrape type for UA53111: 0
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: YA36470
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: VR29597
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: LT01381
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: ZX19467
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: PL33602
2026-03-29 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL33602%27 HTTP/1.1" 200 None
2026-03-29 10:46:35 [auto1.de] INFO: Scrape type for PL33602: 0
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: BC54503
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: SN24216
2026-03-29 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN24216%27 HTTP/1.1" 200 None
2026-03-29 10:46:35 [auto1.de] INFO: Scrape type for SN24216: 0
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: PR44802
2026-03-29 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR44802%27 HTTP/1.1" 200 None
2026-03-29 10:46:35 [auto1.de] INFO: Scrape type for PR44802: 0
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: YR75150
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: TP97389
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: EC10607
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: LE99206
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: KJ49270
2026-03-29 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ49270%27 HTTP/1.1" 200 None
2026-03-29 10:46:35 [auto1.de] INFO: Scrape type for KJ49270: 0
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: ZD15058
2026-03-29 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD15058%27 HTTP/1.1" 200 None
2026-03-29 10:46:35 [auto1.de] INFO: Scrape type for ZD15058: 0
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: PH13735
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: NR79425
2026-03-29 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR79425%27 HTTP/1.1" 200 None
2026-03-29 10:46:35 [auto1.de] INFO: Scrape type for NR79425: 0
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: CY46145
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: UF03546
2026-03-29 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF03546%27 HTTP/1.1" 200 None
2026-03-29 10:46:35 [auto1.de] INFO: Scrape type for UF03546: 0
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: NC58057
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: TF03370
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: WU29396
2026-03-29 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU29396%27 HTTP/1.1" 200 None
2026-03-29 10:46:35 [auto1.de] INFO: Scrape type for WU29396: 0
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: FF37262
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: UL28707
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: LM47126
2026-03-29 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM47126%27 HTTP/1.1" 200 None
2026-03-29 10:46:35 [auto1.de] INFO: Scrape type for LM47126: 0
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: FR17679
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: XG50299
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: MU09493
2026-03-29 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU09493%27 HTTP/1.1" 200 None
2026-03-29 10:46:35 [auto1.de] INFO: Scrape type for MU09493: 0
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: VR85555
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: VB32886
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: EF60589
2026-03-29 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF60589%27 HTTP/1.1" 200 None
2026-03-29 10:46:35 [auto1.de] INFO: Scrape type for EF60589: 0
2026-03-29 10:46:35 [auto1.de] INFO: Found listing with ID: MR72428
2026-03-29 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR72428%27 HTTP/1.1" 200 None
2026-03-29 10:46:35 [auto1.de] INFO: Scrape type for MR72428: 0
2026-03-29 10:46:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:46:36 [auto1.de] INFO: Channel: 24h | Page: 148 | totalHits: 6726 | hits on page: 40
2026-03-29 10:46:36 [auto1.de] INFO: Found listing with ID: UT14776
2026-03-29 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT14776%27 HTTP/1.1" 200 None
2026-03-29 10:46:36 [auto1.de] INFO: Scrape type for UT14776: 0
2026-03-29 10:46:36 [auto1.de] INFO: Found listing with ID: DC55349
2026-03-29 10:46:36 [auto1.de] INFO: Found listing with ID: LR58414
2026-03-29 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR58414%27 HTTP/1.1" 200 None
2026-03-29 10:46:36 [auto1.de] INFO: Scrape type for LR58414: 0
2026-03-29 10:46:36 [auto1.de] INFO: Found listing with ID: HM04559
2026-03-29 10:46:36 [auto1.de] INFO: Found listing with ID: EN17555
2026-03-29 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN17555%27 HTTP/1.1" 200 None
2026-03-29 10:46:36 [auto1.de] INFO: Scrape type for EN17555: 0
2026-03-29 10:46:36 [auto1.de] INFO: Found listing with ID: HN29475
2026-03-29 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN29475%27 HTTP/1.1" 200 None
2026-03-29 10:46:36 [auto1.de] INFO: Scrape type for HN29475: 0
2026-03-29 10:46:36 [auto1.de] INFO: Found listing with ID: UY60901
2026-03-29 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY60901%27 HTTP/1.1" 200 None
2026-03-29 10:46:36 [auto1.de] INFO: Scrape type for UY60901: 0
2026-03-29 10:46:36 [auto1.de] INFO: Found listing with ID: BE81625
2026-03-29 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE81625%27 HTTP/1.1" 200 None
2026-03-29 10:46:36 [auto1.de] INFO: Scrape type for BE81625: 0
2026-03-29 10:46:36 [auto1.de] INFO: Found listing with ID: CE21106
2026-03-29 10:46:36 [auto1.de] INFO: Found listing with ID: GY94515
2026-03-29 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY94515%27 HTTP/1.1" 200 None
2026-03-29 10:46:36 [auto1.de] INFO: Scrape type for GY94515: 0
2026-03-29 10:46:36 [auto1.de] INFO: Found listing with ID: LM12575
2026-03-29 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM12575%27 HTTP/1.1" 200 None
2026-03-29 10:46:36 [auto1.de] INFO: Scrape type for LM12575: 0
2026-03-29 10:46:36 [auto1.de] INFO: Found listing with ID: CV44457
2026-03-29 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV44457%27 HTTP/1.1" 200 None
2026-03-29 10:46:36 [auto1.de] INFO: Scrape type for CV44457: 0
2026-03-29 10:46:36 [auto1.de] INFO: Found listing with ID: BN42758
2026-03-29 10:46:36 [auto1.de] INFO: Found listing with ID: ZH67756
2026-03-29 10:46:36 [auto1.de] INFO: Found listing with ID: PN96283
2026-03-29 10:46:36 [auto1.de] INFO: Found listing with ID: AZ23133
2026-03-29 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ23133%27 HTTP/1.1" 200 None
2026-03-29 10:46:36 [auto1.de] INFO: Scrape type for AZ23133: 0
2026-03-29 10:46:36 [auto1.de] INFO: Found listing with ID: XV62286
2026-03-29 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV62286%27 HTTP/1.1" 200 None
2026-03-29 10:46:36 [auto1.de] INFO: Scrape type for XV62286: 0
2026-03-29 10:46:36 [auto1.de] INFO: Found listing with ID: ZS47010
2026-03-29 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS47010%27 HTTP/1.1" 200 None
2026-03-29 10:46:36 [auto1.de] INFO: Scrape type for ZS47010: 0
2026-03-29 10:46:36 [auto1.de] INFO: Found listing with ID: KZ38664
2026-03-29 10:46:36 [auto1.de] INFO: Found listing with ID: MF03624
2026-03-29 10:46:36 [auto1.de] INFO: Found listing with ID: FX61417
2026-03-29 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX61417%27 HTTP/1.1" 200 None
2026-03-29 10:46:36 [auto1.de] INFO: Scrape type for FX61417: 0
2026-03-29 10:46:36 [auto1.de] INFO: Found listing with ID: EK32140
2026-03-29 10:46:37 [auto1.de] INFO: Found listing with ID: ZG89267
2026-03-29 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG89267%27 HTTP/1.1" 200 None
2026-03-29 10:46:37 [auto1.de] INFO: Scrape type for ZG89267: 0
2026-03-29 10:46:37 [auto1.de] INFO: Found listing with ID: WW30345
2026-03-29 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW30345%27 HTTP/1.1" 200 None
2026-03-29 10:46:37 [auto1.de] INFO: Scrape type for WW30345: 0
2026-03-29 10:46:37 [auto1.de] INFO: Found listing with ID: GE75594
2026-03-29 10:46:37 [auto1.de] INFO: Found listing with ID: BH61935
2026-03-29 10:46:37 [auto1.de] INFO: Found listing with ID: TH50247
2026-03-29 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH50247%27 HTTP/1.1" 200 None
2026-03-29 10:46:37 [auto1.de] INFO: Scrape type for TH50247: 0
2026-03-29 10:46:37 [auto1.de] INFO: Found listing with ID: CV13370
2026-03-29 10:46:37 [auto1.de] INFO: Found listing with ID: GF54025
2026-03-29 10:46:37 [auto1.de] INFO: Found listing with ID: KK05104
2026-03-29 10:46:37 [auto1.de] INFO: Found listing with ID: DT00553
2026-03-29 10:46:37 [auto1.de] INFO: Found listing with ID: LR61927
2026-03-29 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR61927%27 HTTP/1.1" 200 None
2026-03-29 10:46:37 [auto1.de] INFO: Scrape type for LR61927: 0
2026-03-29 10:46:37 [auto1.de] INFO: Found listing with ID: PR38296
2026-03-29 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR38296%27 HTTP/1.1" 200 None
2026-03-29 10:46:37 [auto1.de] INFO: Scrape type for PR38296: 0
2026-03-29 10:46:37 [auto1.de] INFO: Found listing with ID: MN30135
2026-03-29 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN30135%27 HTTP/1.1" 200 None
2026-03-29 10:46:37 [auto1.de] INFO: Scrape type for MN30135: 0
2026-03-29 10:46:37 [auto1.de] INFO: Found listing with ID: GM93554
2026-03-29 10:46:37 [auto1.de] INFO: Found listing with ID: KC33777
2026-03-29 10:46:37 [auto1.de] INFO: Found listing with ID: JD18961
2026-03-29 10:46:37 [auto1.de] INFO: Found listing with ID: EU91257
2026-03-29 10:46:37 [auto1.de] INFO: Found listing with ID: YV19830
2026-03-29 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV19830%27 HTTP/1.1" 200 None
2026-03-29 10:46:37 [auto1.de] INFO: Scrape type for YV19830: 0
2026-03-29 10:46:37 [auto1.de] INFO: Found listing with ID: TF95367
2026-03-29 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF95367%27 HTTP/1.1" 200 None
2026-03-29 10:46:37 [auto1.de] INFO: Scrape type for TF95367: 0
2026-03-29 10:46:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:46:38 [auto1.de] INFO: Channel: 24h | Page: 149 | totalHits: 6726 | hits on page: 40
2026-03-29 10:46:38 [auto1.de] INFO: Found listing with ID: XK86012
2026-03-29 10:46:38 [auto1.de] INFO: Found listing with ID: MJ24427
2026-03-29 10:46:38 [auto1.de] INFO: Found listing with ID: WE87104
2026-03-29 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE87104%27 HTTP/1.1" 200 None
2026-03-29 10:46:38 [auto1.de] INFO: Scrape type for WE87104: 0
2026-03-29 10:46:38 [auto1.de] INFO: Found listing with ID: TY73105
2026-03-29 10:46:38 [auto1.de] INFO: Found listing with ID: ZC07667
2026-03-29 10:46:38 [auto1.de] INFO: Found listing with ID: RY65257
2026-03-29 10:46:38 [auto1.de] INFO: Found listing with ID: YC98449
2026-03-29 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC98449%27 HTTP/1.1" 200 None
2026-03-29 10:46:38 [auto1.de] INFO: Scrape type for YC98449: 0
2026-03-29 10:46:38 [auto1.de] INFO: Found listing with ID: AN00284
2026-03-29 10:46:38 [auto1.de] INFO: Found listing with ID: PW75443
2026-03-29 10:46:38 [auto1.de] INFO: Found listing with ID: XZ09557
2026-03-29 10:46:38 [auto1.de] INFO: Found listing with ID: ZU51849
2026-03-29 10:46:38 [auto1.de] INFO: Found listing with ID: KD69831
2026-03-29 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD69831%27 HTTP/1.1" 200 None
2026-03-29 10:46:38 [auto1.de] INFO: Scrape type for KD69831: 0
2026-03-29 10:46:38 [auto1.de] INFO: Found listing with ID: VS08295
2026-03-29 10:46:38 [auto1.de] INFO: Found listing with ID: DZ10370
2026-03-29 10:46:38 [auto1.de] INFO: Found listing with ID: YE71263
2026-03-29 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE71263%27 HTTP/1.1" 200 None
2026-03-29 10:46:38 [auto1.de] INFO: Scrape type for YE71263: 0
2026-03-29 10:46:38 [auto1.de] INFO: Found listing with ID: PW03502
2026-03-29 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW03502%27 HTTP/1.1" 200 None
2026-03-29 10:46:38 [auto1.de] INFO: Scrape type for PW03502: 0
2026-03-29 10:46:38 [auto1.de] INFO: Found listing with ID: LH85097
2026-03-29 10:46:38 [auto1.de] INFO: Found listing with ID: TZ90544
2026-03-29 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ90544%27 HTTP/1.1" 200 None
2026-03-29 10:46:38 [auto1.de] INFO: Scrape type for TZ90544: 0
2026-03-29 10:46:38 [auto1.de] INFO: Found listing with ID: ZM06899
2026-03-29 10:46:38 [auto1.de] INFO: Found listing with ID: MW28967
2026-03-29 10:46:38 [auto1.de] INFO: Found listing with ID: ZB32219
2026-03-29 10:46:38 [auto1.de] INFO: Found listing with ID: HL71303
2026-03-29 10:46:38 [auto1.de] INFO: Found listing with ID: BU00937
2026-03-29 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU00937%27 HTTP/1.1" 200 None
2026-03-29 10:46:38 [auto1.de] INFO: Scrape type for BU00937: 0
2026-03-29 10:46:38 [auto1.de] INFO: Found listing with ID: CB58662
2026-03-29 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB58662%27 HTTP/1.1" 200 None
2026-03-29 10:46:38 [auto1.de] INFO: Scrape type for CB58662: 0
2026-03-29 10:46:38 [auto1.de] INFO: Found listing with ID: WN13628
2026-03-29 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN13628%27 HTTP/1.1" 200 None
2026-03-29 10:46:38 [auto1.de] INFO: Scrape type for WN13628: 0
2026-03-29 10:46:38 [auto1.de] INFO: Found listing with ID: SC39619
2026-03-29 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC39619%27 HTTP/1.1" 200 None
2026-03-29 10:46:38 [auto1.de] INFO: Scrape type for SC39619: 0
2026-03-29 10:46:38 [auto1.de] INFO: Found listing with ID: HP58071
2026-03-29 10:46:38 [auto1.de] INFO: Found listing with ID: VW03364
2026-03-29 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW03364%27 HTTP/1.1" 200 None
2026-03-29 10:46:38 [auto1.de] INFO: Scrape type for VW03364: 0
2026-03-29 10:46:38 [auto1.de] INFO: Found listing with ID: DN85056
2026-03-29 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN85056%27 HTTP/1.1" 200 None
2026-03-29 10:46:38 [auto1.de] INFO: Scrape type for DN85056: 0
2026-03-29 10:46:38 [auto1.de] INFO: Found listing with ID: DZ90314
2026-03-29 10:46:38 [auto1.de] INFO: Found listing with ID: KV10415
2026-03-29 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV10415%27 HTTP/1.1" 200 None
2026-03-29 10:46:39 [auto1.de] INFO: Scrape type for KV10415: 0
2026-03-29 10:46:39 [auto1.de] INFO: Found listing with ID: SF76682
2026-03-29 10:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF76682%27 HTTP/1.1" 200 None
2026-03-29 10:46:39 [auto1.de] INFO: Scrape type for SF76682: 0
2026-03-29 10:46:39 [auto1.de] INFO: Found listing with ID: CE35567
2026-03-29 10:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE35567%27 HTTP/1.1" 200 None
2026-03-29 10:46:39 [auto1.de] INFO: Scrape type for CE35567: 0
2026-03-29 10:46:39 [auto1.de] INFO: Found listing with ID: EC92138
2026-03-29 10:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC92138%27 HTTP/1.1" 200 None
2026-03-29 10:46:39 [auto1.de] INFO: Scrape type for EC92138: 0
2026-03-29 10:46:39 [auto1.de] INFO: Found listing with ID: RN02934
2026-03-29 10:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN02934%27 HTTP/1.1" 200 None
2026-03-29 10:46:39 [auto1.de] INFO: Scrape type for RN02934: 0
2026-03-29 10:46:39 [auto1.de] INFO: Found listing with ID: UY39264
2026-03-29 10:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY39264%27 HTTP/1.1" 200 None
2026-03-29 10:46:39 [auto1.de] INFO: Scrape type for UY39264: 0
2026-03-29 10:46:39 [auto1.de] INFO: Found listing with ID: ZD05213
2026-03-29 10:46:39 [auto1.de] INFO: Found listing with ID: VL59163
2026-03-29 10:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL59163%27 HTTP/1.1" 200 None
2026-03-29 10:46:39 [auto1.de] INFO: Scrape type for VL59163: 0
2026-03-29 10:46:39 [auto1.de] INFO: Found listing with ID: AH54106
2026-03-29 10:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH54106%27 HTTP/1.1" 200 None
2026-03-29 10:46:39 [auto1.de] INFO: Scrape type for AH54106: 0
2026-03-29 10:46:39 [auto1.de] INFO: Found listing with ID: WC53392
2026-03-29 10:46:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:46:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:46:42 [auto1.de] INFO: Channel: 24h | Page: 150 | totalHits: 6726 | hits on page: 40
2026-03-29 10:46:42 [auto1.de] INFO: Found listing with ID: KB62882
2026-03-29 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB62882%27 HTTP/1.1" 200 None
2026-03-29 10:46:42 [auto1.de] INFO: Scrape type for KB62882: 0
2026-03-29 10:46:42 [auto1.de] INFO: Found listing with ID: JZ33625
2026-03-29 10:46:42 [auto1.de] INFO: Found listing with ID: SS01468
2026-03-29 10:46:42 [auto1.de] INFO: Found listing with ID: RX82336
2026-03-29 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX82336%27 HTTP/1.1" 200 None
2026-03-29 10:46:42 [auto1.de] INFO: Scrape type for RX82336: 0
2026-03-29 10:46:42 [auto1.de] INFO: Found listing with ID: VU61436
2026-03-29 10:46:42 [auto1.de] INFO: Found listing with ID: KE07703
2026-03-29 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE07703%27 HTTP/1.1" 200 None
2026-03-29 10:46:42 [auto1.de] INFO: Scrape type for KE07703: 0
2026-03-29 10:46:42 [auto1.de] INFO: Found listing with ID: EW87662
2026-03-29 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW87662%27 HTTP/1.1" 200 None
2026-03-29 10:46:42 [auto1.de] INFO: Scrape type for EW87662: 0
2026-03-29 10:46:42 [auto1.de] INFO: Found listing with ID: YD79813
2026-03-29 10:46:42 [auto1.de] INFO: Found listing with ID: WS06165
2026-03-29 10:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS06165%27 HTTP/1.1" 200 None
2026-03-29 10:46:43 [auto1.de] INFO: Scrape type for WS06165: 0
2026-03-29 10:46:43 [auto1.de] INFO: Found listing with ID: XE70546
2026-03-29 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE70546%27 HTTP/1.1" 200 None
2026-03-29 10:46:43 [auto1.de] INFO: Scrape type for XE70546: 0
2026-03-29 10:46:43 [auto1.de] INFO: Found listing with ID: JR23306
2026-03-29 10:46:43 [auto1.de] INFO: Found listing with ID: FK29510
2026-03-29 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK29510%27 HTTP/1.1" 200 None
2026-03-29 10:46:43 [auto1.de] INFO: Scrape type for FK29510: 0
2026-03-29 10:46:43 [auto1.de] INFO: Found listing with ID: YN71631
2026-03-29 10:46:43 [auto1.de] INFO: Found listing with ID: AP27322
2026-03-29 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP27322%27 HTTP/1.1" 200 None
2026-03-29 10:46:43 [auto1.de] INFO: Scrape type for AP27322: 0
2026-03-29 10:46:43 [auto1.de] INFO: Found listing with ID: NW52708
2026-03-29 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW52708%27 HTTP/1.1" 200 None
2026-03-29 10:46:43 [auto1.de] INFO: Scrape type for NW52708: 0
2026-03-29 10:46:43 [auto1.de] INFO: Found listing with ID: NH18171
2026-03-29 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH18171%27 HTTP/1.1" 200 None
2026-03-29 10:46:43 [auto1.de] INFO: Scrape type for NH18171: 0
2026-03-29 10:46:43 [auto1.de] INFO: Found listing with ID: EM86154
2026-03-29 10:46:43 [auto1.de] INFO: Found listing with ID: JN22818
2026-03-29 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN22818%27 HTTP/1.1" 200 None
2026-03-29 10:46:43 [auto1.de] INFO: Scrape type for JN22818: 0
2026-03-29 10:46:43 [auto1.de] INFO: Found listing with ID: SK06184
2026-03-29 10:46:43 [auto1.de] INFO: Found listing with ID: SZ07968
2026-03-29 10:46:43 [auto1.de] INFO: Found listing with ID: RT44513
2026-03-29 10:46:43 [auto1.de] INFO: Found listing with ID: JB74543
2026-03-29 10:46:43 [auto1.de] INFO: Found listing with ID: HX73394
2026-03-29 10:46:43 [auto1.de] INFO: Found listing with ID: ES38254
2026-03-29 10:46:43 [auto1.de] INFO: Found listing with ID: PU69799
2026-03-29 10:46:43 [auto1.de] INFO: Found listing with ID: BM68891
2026-03-29 10:46:43 [auto1.de] INFO: Found listing with ID: AN35443
2026-03-29 10:46:43 [auto1.de] INFO: Found listing with ID: XA64298
2026-03-29 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA64298%27 HTTP/1.1" 200 None
2026-03-29 10:46:43 [auto1.de] INFO: Scrape type for XA64298: 0
2026-03-29 10:46:43 [auto1.de] INFO: Found listing with ID: FU18032
2026-03-29 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU18032%27 HTTP/1.1" 200 None
2026-03-29 10:46:43 [auto1.de] INFO: Scrape type for FU18032: 0
2026-03-29 10:46:43 [auto1.de] INFO: Found listing with ID: RT07537
2026-03-29 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT07537%27 HTTP/1.1" 200 None
2026-03-29 10:46:43 [auto1.de] INFO: Scrape type for RT07537: 0
2026-03-29 10:46:43 [auto1.de] INFO: Found listing with ID: CP64572
2026-03-29 10:46:43 [auto1.de] INFO: Found listing with ID: CA31284
2026-03-29 10:46:43 [auto1.de] INFO: Found listing with ID: JE64211
2026-03-29 10:46:43 [auto1.de] INFO: Found listing with ID: FJ20192
2026-03-29 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ20192%27 HTTP/1.1" 200 None
2026-03-29 10:46:43 [auto1.de] INFO: Scrape type for FJ20192: 0
2026-03-29 10:46:43 [auto1.de] INFO: Found listing with ID: ZV42561
2026-03-29 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV42561%27 HTTP/1.1" 200 None
2026-03-29 10:46:43 [auto1.de] INFO: Scrape type for ZV42561: 0
2026-03-29 10:46:43 [auto1.de] INFO: Found listing with ID: YZ24956
2026-03-29 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ24956%27 HTTP/1.1" 200 None
2026-03-29 10:46:43 [auto1.de] INFO: Scrape type for YZ24956: 0
2026-03-29 10:46:43 [auto1.de] INFO: Found listing with ID: RU51924
2026-03-29 10:46:43 [auto1.de] INFO: Found listing with ID: UM98970
2026-03-29 10:46:43 [auto1.de] INFO: Found listing with ID: PP81333
2026-03-29 10:46:43 [auto1.de] INFO: Found listing with ID: DG65550
2026-03-29 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG65550%27 HTTP/1.1" 200 None
2026-03-29 10:46:43 [auto1.de] INFO: Scrape type for DG65550: 0
2026-03-29 10:46:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:46:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:46:44 [auto1.de] INFO: Channel: 24h | Page: 151 | totalHits: 6726 | hits on page: 40
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: SW06849
2026-03-29 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW06849%27 HTTP/1.1" 200 None
2026-03-29 10:46:44 [auto1.de] INFO: Scrape type for SW06849: 0
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: GZ70356
2026-03-29 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ70356%27 HTTP/1.1" 200 None
2026-03-29 10:46:44 [auto1.de] INFO: Scrape type for GZ70356: 0
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: RS29828
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: WB65429
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: BV82977
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: XM98153
2026-03-29 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM98153%27 HTTP/1.1" 200 None
2026-03-29 10:46:44 [auto1.de] INFO: Scrape type for XM98153: 0
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: ZV11386
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: TM97127
2026-03-29 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM97127%27 HTTP/1.1" 200 None
2026-03-29 10:46:44 [auto1.de] INFO: Scrape type for TM97127: 0
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: FW24707
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: ZB09378
2026-03-29 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB09378%27 HTTP/1.1" 200 None
2026-03-29 10:46:44 [auto1.de] INFO: Scrape type for ZB09378: 0
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: NE29415
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: ES97586
2026-03-29 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES97586%27 HTTP/1.1" 200 None
2026-03-29 10:46:44 [auto1.de] INFO: Scrape type for ES97586: 0
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: LF31183
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: RU06209
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: MW27042
2026-03-29 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW27042%27 HTTP/1.1" 200 None
2026-03-29 10:46:44 [auto1.de] INFO: Scrape type for MW27042: 0
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: CN30644
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: VF79484
2026-03-29 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF79484%27 HTTP/1.1" 200 None
2026-03-29 10:46:44 [auto1.de] INFO: Scrape type for VF79484: 0
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: PC42361
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: ZD03679
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: AJ68338
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: XY91311
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: YS53721
2026-03-29 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS53721%27 HTTP/1.1" 200 None
2026-03-29 10:46:44 [auto1.de] INFO: Scrape type for YS53721: 0
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: NX07210
2026-03-29 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX07210%27 HTTP/1.1" 200 None
2026-03-29 10:46:44 [auto1.de] INFO: Scrape type for NX07210: 0
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: UJ32060
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: LR70378
2026-03-29 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR70378%27 HTTP/1.1" 200 None
2026-03-29 10:46:44 [auto1.de] INFO: Scrape type for LR70378: 0
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: VX51529
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: ZX35580
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: MB10012
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: JB16135
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: WX88880
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: VG60095
2026-03-29 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG60095%27 HTTP/1.1" 200 None
2026-03-29 10:46:44 [auto1.de] INFO: Scrape type for VG60095: 0
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: AL99999
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: NW19977
2026-03-29 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW19977%27 HTTP/1.1" 200 None
2026-03-29 10:46:44 [auto1.de] INFO: Scrape type for NW19977: 0
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: LD20816
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: FR59515
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: ND45572
2026-03-29 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND45572%27 HTTP/1.1" 200 None
2026-03-29 10:46:44 [auto1.de] INFO: Scrape type for ND45572: 0
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: XK76650
2026-03-29 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK76650%27 HTTP/1.1" 200 None
2026-03-29 10:46:44 [auto1.de] INFO: Scrape type for XK76650: 0
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: CL01053
2026-03-29 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL01053%27 HTTP/1.1" 200 None
2026-03-29 10:46:44 [auto1.de] INFO: Scrape type for CL01053: 0
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: PB68045
2026-03-29 10:46:44 [auto1.de] INFO: Found listing with ID: TD36353
2026-03-29 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD36353%27 HTTP/1.1" 200 None
2026-03-29 10:46:44 [auto1.de] INFO: Scrape type for TD36353: 0
2026-03-29 10:46:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:46:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:46:46 [auto1.de] INFO: Channel: 24h | Page: 152 | totalHits: 6726 | hits on page: 40
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: UX88157
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX88157%27 HTTP/1.1" 200 None
2026-03-29 10:46:46 [auto1.de] INFO: Scrape type for UX88157: 0
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: PS96436
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS96436%27 HTTP/1.1" 200 None
2026-03-29 10:46:46 [auto1.de] INFO: Scrape type for PS96436: 0
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: CA26041
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA26041%27 HTTP/1.1" 200 None
2026-03-29 10:46:46 [auto1.de] INFO: Scrape type for CA26041: 0
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: FK87134
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: AC64408
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: MS92853
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: HJ08295
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ08295%27 HTTP/1.1" 200 None
2026-03-29 10:46:46 [auto1.de] INFO: Scrape type for HJ08295: 0
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: KJ96076
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: AL40501
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL40501%27 HTTP/1.1" 200 None
2026-03-29 10:46:46 [auto1.de] INFO: Scrape type for AL40501: 0
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: US66744
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: WF58596
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF58596%27 HTTP/1.1" 200 None
2026-03-29 10:46:46 [auto1.de] INFO: Scrape type for WF58596: 0
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: HP30052
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP30052%27 HTTP/1.1" 200 None
2026-03-29 10:46:46 [auto1.de] INFO: Scrape type for HP30052: 0
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: RT47702
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT47702%27 HTTP/1.1" 200 None
2026-03-29 10:46:46 [auto1.de] INFO: Scrape type for RT47702: 0
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: GB90564
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: RL85498
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: NV50024
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: WB83413
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: NX27502
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: BY26931
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY26931%27 HTTP/1.1" 200 None
2026-03-29 10:46:46 [auto1.de] INFO: Scrape type for BY26931: 0
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: MF21991
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: MV86263
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV86263%27 HTTP/1.1" 200 None
2026-03-29 10:46:46 [auto1.de] INFO: Scrape type for MV86263: 0
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: XR92513
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: GZ82101
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: MH61351
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH61351%27 HTTP/1.1" 200 None
2026-03-29 10:46:46 [auto1.de] INFO: Scrape type for MH61351: 0
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: FT59815
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: TT73177
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT73177%27 HTTP/1.1" 200 None
2026-03-29 10:46:46 [auto1.de] INFO: Scrape type for TT73177: 0
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: TN55271
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: DZ73228
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ73228%27 HTTP/1.1" 200 None
2026-03-29 10:46:46 [auto1.de] INFO: Scrape type for DZ73228: 0
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: ZA78506
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: BT55955
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT55955%27 HTTP/1.1" 200 None
2026-03-29 10:46:46 [auto1.de] INFO: Scrape type for BT55955: 0
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: XT21551
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT21551%27 HTTP/1.1" 200 None
2026-03-29 10:46:46 [auto1.de] INFO: Scrape type for XT21551: 0
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: KB45443
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB45443%27 HTTP/1.1" 200 None
2026-03-29 10:46:46 [auto1.de] INFO: Scrape type for KB45443: 0
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: XT20747
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: GF23268
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: YD01023
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: GJ73585
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: VA37364
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA37364%27 HTTP/1.1" 200 None
2026-03-29 10:46:46 [auto1.de] INFO: Scrape type for VA37364: 0
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: CA66668
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA66668%27 HTTP/1.1" 200 None
2026-03-29 10:46:46 [auto1.de] INFO: Scrape type for CA66668: 0
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: NZ98006
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ98006%27 HTTP/1.1" 200 None
2026-03-29 10:46:46 [auto1.de] INFO: Scrape type for NZ98006: 0
2026-03-29 10:46:46 [auto1.de] INFO: Found listing with ID: MP14986
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP14986%27 HTTP/1.1" 200 None
2026-03-29 10:46:46 [auto1.de] INFO: Scrape type for MP14986: 0
2026-03-29 10:46:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:46:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:46:47 [auto1.de] INFO: Channel: 24h | Page: 153 | totalHits: 6726 | hits on page: 40
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: YC95910
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: KU30255
2026-03-29 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU30255%27 HTTP/1.1" 200 None
2026-03-29 10:46:47 [auto1.de] INFO: Scrape type for KU30255: 0
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: HE47734
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: JR52179
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: LD23223
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: LM31898
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: HL01555
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: WJ67055
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: EJ09183
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: TM08126
2026-03-29 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM08126%27 HTTP/1.1" 200 None
2026-03-29 10:46:47 [auto1.de] INFO: Scrape type for TM08126: 0
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: GZ17275
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: JG89144
2026-03-29 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG89144%27 HTTP/1.1" 200 None
2026-03-29 10:46:47 [auto1.de] INFO: Scrape type for JG89144: 0
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: GY04691
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: JD07645
2026-03-29 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD07645%27 HTTP/1.1" 200 None
2026-03-29 10:46:47 [auto1.de] INFO: Scrape type for JD07645: 0
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: WD20973
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: RN07993
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: NT23997
2026-03-29 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT23997%27 HTTP/1.1" 200 None
2026-03-29 10:46:47 [auto1.de] INFO: Scrape type for NT23997: 0
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: EC99072
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: EN09392
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: DT06996
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: LX07481
2026-03-29 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX07481%27 HTTP/1.1" 200 None
2026-03-29 10:46:47 [auto1.de] INFO: Scrape type for LX07481: 0
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: DK35136
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: WJ60429
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: RX22328
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: XE09172
2026-03-29 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE09172%27 HTTP/1.1" 200 None
2026-03-29 10:46:47 [auto1.de] INFO: Scrape type for XE09172: 0
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: ST78231
2026-03-29 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST78231%27 HTTP/1.1" 200 None
2026-03-29 10:46:47 [auto1.de] INFO: Scrape type for ST78231: 0
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: FG48361
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: VE13678
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: XX85358
2026-03-29 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX85358%27 HTTP/1.1" 200 None
2026-03-29 10:46:47 [auto1.de] INFO: Scrape type for XX85358: 0
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: WM91088
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: NY40403
2026-03-29 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY40403%27 HTTP/1.1" 200 None
2026-03-29 10:46:47 [auto1.de] INFO: Scrape type for NY40403: 0
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: JY99626
2026-03-29 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY99626%27 HTTP/1.1" 200 None
2026-03-29 10:46:47 [auto1.de] INFO: Scrape type for JY99626: 0
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: CG06120
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: XX47236
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: MA20139
2026-03-29 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA20139%27 HTTP/1.1" 200 None
2026-03-29 10:46:47 [auto1.de] INFO: Scrape type for MA20139: 0
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: GK17224
2026-03-29 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK17224%27 HTTP/1.1" 200 None
2026-03-29 10:46:47 [auto1.de] INFO: Scrape type for GK17224: 0
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: AY24824
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: CE16613
2026-03-29 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE16613%27 HTTP/1.1" 200 None
2026-03-29 10:46:47 [auto1.de] INFO: Scrape type for CE16613: 0
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: AK16963
2026-03-29 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK16963%27 HTTP/1.1" 200 None
2026-03-29 10:46:47 [auto1.de] INFO: Scrape type for AK16963: 0
2026-03-29 10:46:47 [auto1.de] INFO: Found listing with ID: PG11291
2026-03-29 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG11291%27 HTTP/1.1" 200 None
2026-03-29 10:46:47 [auto1.de] INFO: Scrape type for PG11291: 0
2026-03-29 10:46:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:46:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:46:49 [auto1.de] INFO: Channel: 24h | Page: 154 | totalHits: 6726 | hits on page: 40
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: HE64708
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE64708%27 HTTP/1.1" 200 None
2026-03-29 10:46:49 [auto1.de] INFO: Scrape type for HE64708: 0
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: ZK51432
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK51432%27 HTTP/1.1" 200 None
2026-03-29 10:46:49 [auto1.de] INFO: Scrape type for ZK51432: 0
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: JR48888
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: JU28029
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU28029%27 HTTP/1.1" 200 None
2026-03-29 10:46:49 [auto1.de] INFO: Scrape type for JU28029: 0
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: WX17645
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: BE75867
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE75867%27 HTTP/1.1" 200 None
2026-03-29 10:46:49 [auto1.de] INFO: Scrape type for BE75867: 0
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: FP27721
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: KV56642
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV56642%27 HTTP/1.1" 200 None
2026-03-29 10:46:49 [auto1.de] INFO: Scrape type for KV56642: 0
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: KC60426
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: ZU41188
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU41188%27 HTTP/1.1" 200 None
2026-03-29 10:46:49 [auto1.de] INFO: Scrape type for ZU41188: 0
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: VD40849
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD40849%27 HTTP/1.1" 200 None
2026-03-29 10:46:49 [auto1.de] INFO: Scrape type for VD40849: 0
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: EL78604
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: ZA94641
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA94641%27 HTTP/1.1" 200 None
2026-03-29 10:46:49 [auto1.de] INFO: Scrape type for ZA94641: 0
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: YL33228
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL33228%27 HTTP/1.1" 200 None
2026-03-29 10:46:49 [auto1.de] INFO: Scrape type for YL33228: 0
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: XU87047
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU87047%27 HTTP/1.1" 200 None
2026-03-29 10:46:49 [auto1.de] INFO: Scrape type for XU87047: 0
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: KP52427
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: GW71090
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW71090%27 HTTP/1.1" 200 None
2026-03-29 10:46:49 [auto1.de] INFO: Scrape type for GW71090: 0
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: UZ60031
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: FD59666
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD59666%27 HTTP/1.1" 200 None
2026-03-29 10:46:49 [auto1.de] INFO: Scrape type for FD59666: 0
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: YP26052
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: UW39915
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW39915%27 HTTP/1.1" 200 None
2026-03-29 10:46:49 [auto1.de] INFO: Scrape type for UW39915: 0
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: GC53202
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC53202%27 HTTP/1.1" 200 None
2026-03-29 10:46:49 [auto1.de] INFO: Scrape type for GC53202: 0
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: RF84100
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF84100%27 HTTP/1.1" 200 None
2026-03-29 10:46:49 [auto1.de] INFO: Scrape type for RF84100: 0
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: BW84058
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW84058%27 HTTP/1.1" 200 None
2026-03-29 10:46:49 [auto1.de] INFO: Scrape type for BW84058: 0
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: WJ96014
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ96014%27 HTTP/1.1" 200 None
2026-03-29 10:46:49 [auto1.de] INFO: Scrape type for WJ96014: 0
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: UX04638
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: XT42092
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: ER27214
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: VK18000
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK18000%27 HTTP/1.1" 200 None
2026-03-29 10:46:49 [auto1.de] INFO: Scrape type for VK18000: 0
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: ZJ88951
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ88951%27 HTTP/1.1" 200 None
2026-03-29 10:46:49 [auto1.de] INFO: Scrape type for ZJ88951: 0
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: DS51520
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS51520%27 HTTP/1.1" 200 None
2026-03-29 10:46:49 [auto1.de] INFO: Scrape type for DS51520: 0
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: DU68074
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: AX34662
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX34662%27 HTTP/1.1" 200 None
2026-03-29 10:46:49 [auto1.de] INFO: Scrape type for AX34662: 0
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: VP32069
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP32069%27 HTTP/1.1" 200 None
2026-03-29 10:46:49 [auto1.de] INFO: Scrape type for VP32069: 0
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: ZU11253
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU11253%27 HTTP/1.1" 200 None
2026-03-29 10:46:49 [auto1.de] INFO: Scrape type for ZU11253: 0
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: ZN38550
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: TR40985
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: BW25069
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: UH14714
2026-03-29 10:46:49 [auto1.de] INFO: Found listing with ID: WR70011
2026-03-29 10:46:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:46:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:46:50 [auto1.de] INFO: Channel: 24h | Page: 155 | totalHits: 6726 | hits on page: 40
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: FL42692
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL42692%27 HTTP/1.1" 200 None
2026-03-29 10:46:50 [auto1.de] INFO: Scrape type for FL42692: 0
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: UP55636
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: EP24311
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP24311%27 HTTP/1.1" 200 None
2026-03-29 10:46:50 [auto1.de] INFO: Scrape type for EP24311: 0
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: ZT83144
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: UY91981
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: AX05001
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX05001%27 HTTP/1.1" 200 None
2026-03-29 10:46:50 [auto1.de] INFO: Scrape type for AX05001: 0
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: LT27218
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT27218%27 HTTP/1.1" 200 None
2026-03-29 10:46:50 [auto1.de] INFO: Scrape type for LT27218: 0
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: TG23617
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG23617%27 HTTP/1.1" 200 None
2026-03-29 10:46:50 [auto1.de] INFO: Scrape type for TG23617: 0
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: DL01383
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL01383%27 HTTP/1.1" 200 None
2026-03-29 10:46:50 [auto1.de] INFO: Scrape type for DL01383: 0
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: VR01975
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: BC68366
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC68366%27 HTTP/1.1" 200 None
2026-03-29 10:46:50 [auto1.de] INFO: Scrape type for BC68366: 0
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: UW30616
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW30616%27 HTTP/1.1" 200 None
2026-03-29 10:46:50 [auto1.de] INFO: Scrape type for UW30616: 0
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: RT08508
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT08508%27 HTTP/1.1" 200 None
2026-03-29 10:46:50 [auto1.de] INFO: Scrape type for RT08508: 0
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: HL66974
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: CJ73141
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: LT88740
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: FE36611
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: MY97693
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY97693%27 HTTP/1.1" 200 None
2026-03-29 10:46:50 [auto1.de] INFO: Scrape type for MY97693: 0
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: VH99628
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH99628%27 HTTP/1.1" 200 None
2026-03-29 10:46:50 [auto1.de] INFO: Scrape type for VH99628: 0
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: ST78057
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: PV80087
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: HD58306
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD58306%27 HTTP/1.1" 200 None
2026-03-29 10:46:50 [auto1.de] INFO: Scrape type for HD58306: 0
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: KY32435
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: BE46966
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE46966%27 HTTP/1.1" 200 None
2026-03-29 10:46:50 [auto1.de] INFO: Scrape type for BE46966: 0
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: ZZ46464
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ46464%27 HTTP/1.1" 200 None
2026-03-29 10:46:50 [auto1.de] INFO: Scrape type for ZZ46464: 0
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: PY07739
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: NX87227
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX87227%27 HTTP/1.1" 200 None
2026-03-29 10:46:50 [auto1.de] INFO: Scrape type for NX87227: 0
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: TH73061
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH73061%27 HTTP/1.1" 200 None
2026-03-29 10:46:50 [auto1.de] INFO: Scrape type for TH73061: 0
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: DN86096
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: YK83419
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK83419%27 HTTP/1.1" 200 None
2026-03-29 10:46:50 [auto1.de] INFO: Scrape type for YK83419: 0
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: RV77607
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: PS10948
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS10948%27 HTTP/1.1" 200 None
2026-03-29 10:46:50 [auto1.de] INFO: Scrape type for PS10948: 0
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: HF23324
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF23324%27 HTTP/1.1" 200 None
2026-03-29 10:46:50 [auto1.de] INFO: Scrape type for HF23324: 0
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: XA19312
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA19312%27 HTTP/1.1" 200 None
2026-03-29 10:46:50 [auto1.de] INFO: Scrape type for XA19312: 0
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: UP26126
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: GP53136
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP53136%27 HTTP/1.1" 200 None
2026-03-29 10:46:50 [auto1.de] INFO: Scrape type for GP53136: 0
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: TV59519
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: XL14326
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL14326%27 HTTP/1.1" 200 None
2026-03-29 10:46:50 [auto1.de] INFO: Scrape type for XL14326: 0
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: AC34212
2026-03-29 10:46:50 [auto1.de] INFO: Found listing with ID: EW67018
2026-03-29 10:46:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:46:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:46:52 [auto1.de] INFO: Channel: 24h | Page: 156 | totalHits: 6726 | hits on page: 40
2026-03-29 10:46:52 [auto1.de] INFO: Found listing with ID: KN87388
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN87388%27 HTTP/1.1" 200 None
2026-03-29 10:46:52 [auto1.de] INFO: Scrape type for KN87388: 0
2026-03-29 10:46:52 [auto1.de] INFO: Found listing with ID: MB20164
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB20164%27 HTTP/1.1" 200 None
2026-03-29 10:46:52 [auto1.de] INFO: Scrape type for MB20164: 0
2026-03-29 10:46:52 [auto1.de] INFO: Found listing with ID: HL64703
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL64703%27 HTTP/1.1" 200 None
2026-03-29 10:46:52 [auto1.de] INFO: Scrape type for HL64703: 0
2026-03-29 10:46:52 [auto1.de] INFO: Found listing with ID: YW30232
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW30232%27 HTTP/1.1" 200 None
2026-03-29 10:46:52 [auto1.de] INFO: Scrape type for YW30232: 0
2026-03-29 10:46:52 [auto1.de] INFO: Found listing with ID: AL30364
2026-03-29 10:46:52 [auto1.de] INFO: Found listing with ID: FW19107
2026-03-29 10:46:52 [auto1.de] INFO: Found listing with ID: HF87037
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF87037%27 HTTP/1.1" 200 None
2026-03-29 10:46:52 [auto1.de] INFO: Scrape type for HF87037: 0
2026-03-29 10:46:52 [auto1.de] INFO: Found listing with ID: SJ02125
2026-03-29 10:46:52 [auto1.de] INFO: Found listing with ID: GZ99340
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ99340%27 HTTP/1.1" 200 None
2026-03-29 10:46:52 [auto1.de] INFO: Scrape type for GZ99340: 0
2026-03-29 10:46:52 [auto1.de] INFO: Found listing with ID: VL24807
2026-03-29 10:46:52 [auto1.de] INFO: Found listing with ID: FB16153
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB16153%27 HTTP/1.1" 200 None
2026-03-29 10:46:52 [auto1.de] INFO: Scrape type for FB16153: 0
2026-03-29 10:46:52 [auto1.de] INFO: Found listing with ID: AX69067
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX69067%27 HTTP/1.1" 200 None
2026-03-29 10:46:52 [auto1.de] INFO: Scrape type for AX69067: 0
2026-03-29 10:46:52 [auto1.de] INFO: Found listing with ID: CM63557
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM63557%27 HTTP/1.1" 200 None
2026-03-29 10:46:52 [auto1.de] INFO: Scrape type for CM63557: 0
2026-03-29 10:46:52 [auto1.de] INFO: Found listing with ID: YR62229
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR62229%27 HTTP/1.1" 200 None
2026-03-29 10:46:52 [auto1.de] INFO: Scrape type for YR62229: 0
2026-03-29 10:46:52 [auto1.de] INFO: Found listing with ID: NF97550
2026-03-29 10:46:52 [auto1.de] INFO: Found listing with ID: AR94395
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR94395%27 HTTP/1.1" 200 None
2026-03-29 10:46:52 [auto1.de] INFO: Scrape type for AR94395: 0
2026-03-29 10:46:52 [auto1.de] INFO: Found listing with ID: RF06599
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF06599%27 HTTP/1.1" 200 None
2026-03-29 10:46:52 [auto1.de] INFO: Scrape type for RF06599: 0
2026-03-29 10:46:52 [auto1.de] INFO: Found listing with ID: AD51126
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD51126%27 HTTP/1.1" 200 None
2026-03-29 10:46:52 [auto1.de] INFO: Scrape type for AD51126: 0
2026-03-29 10:46:52 [auto1.de] INFO: Found listing with ID: ZA82087
2026-03-29 10:46:52 [auto1.de] INFO: Found listing with ID: PR51827
2026-03-29 10:46:52 [auto1.de] INFO: Found listing with ID: KU26816
2026-03-29 10:46:52 [auto1.de] INFO: Found listing with ID: LD78650
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD78650%27 HTTP/1.1" 200 None
2026-03-29 10:46:52 [auto1.de] INFO: Scrape type for LD78650: 0
2026-03-29 10:46:52 [auto1.de] INFO: Found listing with ID: KB26549
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB26549%27 HTTP/1.1" 200 None
2026-03-29 10:46:52 [auto1.de] INFO: Scrape type for KB26549: 0
2026-03-29 10:46:52 [auto1.de] INFO: Found listing with ID: VL06986
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL06986%27 HTTP/1.1" 200 None
2026-03-29 10:46:52 [auto1.de] INFO: Scrape type for VL06986: 0
2026-03-29 10:46:52 [auto1.de] INFO: Found listing with ID: WB94106
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB94106%27 HTTP/1.1" 200 None
2026-03-29 10:46:52 [auto1.de] INFO: Scrape type for WB94106: 0
2026-03-29 10:46:52 [auto1.de] INFO: Found listing with ID: ZP72952
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP72952%27 HTTP/1.1" 200 None
2026-03-29 10:46:52 [auto1.de] INFO: Scrape type for ZP72952: 0
2026-03-29 10:46:52 [auto1.de] INFO: Found listing with ID: CM42106
2026-03-29 10:46:52 [auto1.de] INFO: Found listing with ID: UP78086
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP78086%27 HTTP/1.1" 200 None
2026-03-29 10:46:52 [auto1.de] INFO: Scrape type for UP78086: 0
2026-03-29 10:46:52 [auto1.de] INFO: Found listing with ID: WP34859
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP34859%27 HTTP/1.1" 200 None
2026-03-29 10:46:52 [auto1.de] INFO: Scrape type for WP34859: 0
2026-03-29 10:46:52 [auto1.de] INFO: Found listing with ID: UR14680
2026-03-29 10:46:53 [auto1.de] INFO: Found listing with ID: JS00894
2026-03-29 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS00894%27 HTTP/1.1" 200 None
2026-03-29 10:46:53 [auto1.de] INFO: Scrape type for JS00894: 0
2026-03-29 10:46:53 [auto1.de] INFO: Found listing with ID: GZ33681
2026-03-29 10:46:53 [auto1.de] INFO: Found listing with ID: KE41699
2026-03-29 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE41699%27 HTTP/1.1" 200 None
2026-03-29 10:46:53 [auto1.de] INFO: Scrape type for KE41699: 0
2026-03-29 10:46:53 [auto1.de] INFO: Found listing with ID: WH78013
2026-03-29 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH78013%27 HTTP/1.1" 200 None
2026-03-29 10:46:53 [auto1.de] INFO: Scrape type for WH78013: 0
2026-03-29 10:46:53 [auto1.de] INFO: Found listing with ID: GL25834
2026-03-29 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL25834%27 HTTP/1.1" 200 None
2026-03-29 10:46:53 [auto1.de] INFO: Scrape type for GL25834: 0
2026-03-29 10:46:53 [auto1.de] INFO: Found listing with ID: AB16604
2026-03-29 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB16604%27 HTTP/1.1" 200 None
2026-03-29 10:46:53 [auto1.de] INFO: Scrape type for AB16604: 0
2026-03-29 10:46:53 [auto1.de] INFO: Found listing with ID: PM83477
2026-03-29 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM83477%27 HTTP/1.1" 200 None
2026-03-29 10:46:53 [auto1.de] INFO: Scrape type for PM83477: 0
2026-03-29 10:46:53 [auto1.de] INFO: Found listing with ID: XE10609
2026-03-29 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE10609%27 HTTP/1.1" 200 None
2026-03-29 10:46:53 [auto1.de] INFO: Scrape type for XE10609: 0
2026-03-29 10:46:53 [auto1.de] INFO: Found listing with ID: XT67395
2026-03-29 10:46:53 [auto1.de] INFO: Found listing with ID: XT85364
2026-03-29 10:46:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:46:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:46:54 [auto1.de] INFO: Channel: 24h | Page: 157 | totalHits: 6726 | hits on page: 40
2026-03-29 10:46:54 [auto1.de] INFO: Found listing with ID: AU58197
2026-03-29 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU58197%27 HTTP/1.1" 200 None
2026-03-29 10:46:54 [auto1.de] INFO: Scrape type for AU58197: 0
2026-03-29 10:46:54 [auto1.de] INFO: Found listing with ID: KJ39198
2026-03-29 10:46:54 [auto1.de] INFO: Found listing with ID: ED37424
2026-03-29 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED37424%27 HTTP/1.1" 200 None
2026-03-29 10:46:54 [auto1.de] INFO: Scrape type for ED37424: 0
2026-03-29 10:46:54 [auto1.de] INFO: Found listing with ID: HP09567
2026-03-29 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP09567%27 HTTP/1.1" 200 None
2026-03-29 10:46:54 [auto1.de] INFO: Scrape type for HP09567: 0
2026-03-29 10:46:54 [auto1.de] INFO: Found listing with ID: EX55373
2026-03-29 10:46:54 [auto1.de] INFO: Found listing with ID: BN44220
2026-03-29 10:46:54 [auto1.de] INFO: Found listing with ID: YV25001
2026-03-29 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV25001%27 HTTP/1.1" 200 None
2026-03-29 10:46:54 [auto1.de] INFO: Scrape type for YV25001: 0
2026-03-29 10:46:54 [auto1.de] INFO: Found listing with ID: DF34301
2026-03-29 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF34301%27 HTTP/1.1" 200 None
2026-03-29 10:46:54 [auto1.de] INFO: Scrape type for DF34301: 0
2026-03-29 10:46:54 [auto1.de] INFO: Found listing with ID: KT60539
2026-03-29 10:46:54 [auto1.de] INFO: Found listing with ID: VA98416
2026-03-29 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA98416%27 HTTP/1.1" 200 None
2026-03-29 10:46:54 [auto1.de] INFO: Scrape type for VA98416: 0
2026-03-29 10:46:54 [auto1.de] INFO: Found listing with ID: JM65569
2026-03-29 10:46:54 [auto1.de] INFO: Found listing with ID: LX23482
2026-03-29 10:46:54 [auto1.de] INFO: Found listing with ID: RS04004
2026-03-29 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS04004%27 HTTP/1.1" 200 None
2026-03-29 10:46:54 [auto1.de] INFO: Scrape type for RS04004: 0
2026-03-29 10:46:54 [auto1.de] INFO: Found listing with ID: KC29293
2026-03-29 10:46:54 [auto1.de] INFO: Found listing with ID: EP86808
2026-03-29 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP86808%27 HTTP/1.1" 200 None
2026-03-29 10:46:54 [auto1.de] INFO: Scrape type for EP86808: 0
2026-03-29 10:46:54 [auto1.de] INFO: Found listing with ID: YA04256
2026-03-29 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA04256%27 HTTP/1.1" 200 None
2026-03-29 10:46:54 [auto1.de] INFO: Scrape type for YA04256: 0
2026-03-29 10:46:54 [auto1.de] INFO: Found listing with ID: WS15050
2026-03-29 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS15050%27 HTTP/1.1" 200 None
2026-03-29 10:46:54 [auto1.de] INFO: Scrape type for WS15050: 0
2026-03-29 10:46:54 [auto1.de] INFO: Found listing with ID: HM10485
2026-03-29 10:46:54 [auto1.de] INFO: Found listing with ID: GZ74020
2026-03-29 10:46:54 [auto1.de] INFO: Found listing with ID: HZ02763
2026-03-29 10:46:54 [auto1.de] INFO: Found listing with ID: KZ16493
2026-03-29 10:46:54 [auto1.de] INFO: Found listing with ID: UN41694
2026-03-29 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN41694%27 HTTP/1.1" 200 None
2026-03-29 10:46:54 [auto1.de] INFO: Scrape type for UN41694: 0
2026-03-29 10:46:54 [auto1.de] INFO: Found listing with ID: DF05561
2026-03-29 10:46:54 [auto1.de] INFO: Found listing with ID: GK39429
2026-03-29 10:46:54 [auto1.de] INFO: Found listing with ID: UJ06873
2026-03-29 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ06873%27 HTTP/1.1" 200 None
2026-03-29 10:46:54 [auto1.de] INFO: Scrape type for UJ06873: 0
2026-03-29 10:46:54 [auto1.de] INFO: Found listing with ID: KR32445
2026-03-29 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR32445%27 HTTP/1.1" 200 None
2026-03-29 10:46:54 [auto1.de] INFO: Scrape type for KR32445: 0
2026-03-29 10:46:54 [auto1.de] INFO: Found listing with ID: MV07839
2026-03-29 10:46:54 [auto1.de] INFO: Found listing with ID: YR28195
2026-03-29 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR28195%27 HTTP/1.1" 200 None
2026-03-29 10:46:54 [auto1.de] INFO: Scrape type for YR28195: 0
2026-03-29 10:46:54 [auto1.de] INFO: Found listing with ID: AW19440
2026-03-29 10:46:54 [auto1.de] INFO: Found listing with ID: DG41556
2026-03-29 10:46:54 [auto1.de] INFO: Found listing with ID: SR75246
2026-03-29 10:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR75246%27 HTTP/1.1" 200 None
2026-03-29 10:46:55 [auto1.de] INFO: Scrape type for SR75246: 0
2026-03-29 10:46:55 [auto1.de] INFO: Found listing with ID: HU15676
2026-03-29 10:46:55 [auto1.de] INFO: Found listing with ID: SV56483
2026-03-29 10:46:55 [auto1.de] INFO: Found listing with ID: ZM61762
2026-03-29 10:46:55 [auto1.de] INFO: Found listing with ID: SC91438
2026-03-29 10:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC91438%27 HTTP/1.1" 200 None
2026-03-29 10:46:55 [auto1.de] INFO: Scrape type for SC91438: 0
2026-03-29 10:46:55 [auto1.de] INFO: Found listing with ID: LJ25581
2026-03-29 10:46:55 [auto1.de] INFO: Found listing with ID: LL75700
2026-03-29 10:46:55 [auto1.de] INFO: Found listing with ID: RG78174
2026-03-29 10:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG78174%27 HTTP/1.1" 200 None
2026-03-29 10:46:55 [auto1.de] INFO: Scrape type for RG78174: 0
2026-03-29 10:46:55 [auto1.de] INFO: Found listing with ID: NG57043
2026-03-29 10:46:55 [auto1.de] INFO: Found listing with ID: SK20247
2026-03-29 10:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK20247%27 HTTP/1.1" 200 None
2026-03-29 10:46:55 [auto1.de] INFO: Scrape type for SK20247: 0
2026-03-29 10:46:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:46:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:46:56 [auto1.de] INFO: Channel: 24h | Page: 158 | totalHits: 6726 | hits on page: 40
2026-03-29 10:46:56 [auto1.de] INFO: Found listing with ID: KY61393
2026-03-29 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY61393%27 HTTP/1.1" 200 None
2026-03-29 10:46:56 [auto1.de] INFO: Scrape type for KY61393: 0
2026-03-29 10:46:56 [auto1.de] INFO: Found listing with ID: XA48872
2026-03-29 10:46:56 [auto1.de] INFO: Found listing with ID: ZZ30319
2026-03-29 10:46:56 [auto1.de] INFO: Found listing with ID: HK51191
2026-03-29 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK51191%27 HTTP/1.1" 200 None
2026-03-29 10:46:56 [auto1.de] INFO: Scrape type for HK51191: 0
2026-03-29 10:46:56 [auto1.de] INFO: Found listing with ID: FJ78997
2026-03-29 10:46:56 [auto1.de] INFO: Found listing with ID: NH81778
2026-03-29 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH81778%27 HTTP/1.1" 200 None
2026-03-29 10:46:56 [auto1.de] INFO: Scrape type for NH81778: 0
2026-03-29 10:46:56 [auto1.de] INFO: Found listing with ID: SC04632
2026-03-29 10:46:56 [auto1.de] INFO: Found listing with ID: CA87929
2026-03-29 10:46:56 [auto1.de] INFO: Found listing with ID: GL40281
2026-03-29 10:46:56 [auto1.de] INFO: Found listing with ID: RZ32125
2026-03-29 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ32125%27 HTTP/1.1" 200 None
2026-03-29 10:46:56 [auto1.de] INFO: Scrape type for RZ32125: 0
2026-03-29 10:46:56 [auto1.de] INFO: Found listing with ID: LC33446
2026-03-29 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC33446%27 HTTP/1.1" 200 None
2026-03-29 10:46:56 [auto1.de] INFO: Scrape type for LC33446: 0
2026-03-29 10:46:56 [auto1.de] INFO: Found listing with ID: JA37481
2026-03-29 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA37481%27 HTTP/1.1" 200 None
2026-03-29 10:46:56 [auto1.de] INFO: Scrape type for JA37481: 0
2026-03-29 10:46:56 [auto1.de] INFO: Found listing with ID: ZT00661
2026-03-29 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT00661%27 HTTP/1.1" 200 None
2026-03-29 10:46:56 [auto1.de] INFO: Scrape type for ZT00661: 0
2026-03-29 10:46:56 [auto1.de] INFO: Found listing with ID: WC65602
2026-03-29 10:46:56 [auto1.de] INFO: Found listing with ID: HF13996
2026-03-29 10:46:56 [auto1.de] INFO: Found listing with ID: RX58241
2026-03-29 10:46:56 [auto1.de] INFO: Found listing with ID: DG46200
2026-03-29 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG46200%27 HTTP/1.1" 200 None
2026-03-29 10:46:56 [auto1.de] INFO: Scrape type for DG46200: 2
2026-03-29 10:46:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9a72b18-588d-5085-b89f-6448e85a5c91 with identifier: DG46200
2026-03-29 10:46:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9a72b18-588d-5085-b89f-6448e85a5c91 with scrape type 2
2026-03-29 10:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9a72b18-588d-5085-b89f-6448e85a5c91 with scrape type 2
2026-03-29 10:46:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9a72b18-588d-5085-b89f-6448e85a5c91, identifier: DG46200
2026-03-29 10:46:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9a72b18-588d-5085-b89f-6448e85a5c91 with identifier: DG46200
2026-03-29 10:46:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9a72b18-588d-5085-b89f-6448e85a5c91 with identifier: DG46200
2026-03-29 10:46:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9a72b18-588d-5085-b89f-6448e85a5c91 with identifier: DG46200 to the API
2026-03-29 10:46:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:46:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:46:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:46:51Z',
 'fuel_type': 'petrol',
 'id': 'a9a72b18-588d-5085-b89f-6448e85a5c91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG46200',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 159787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-12',
 'seller_name': None,
 'title': 'BMW 5er 528i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-29 10:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG46200%27 HTTP/1.1" 200 None
2026-03-29 10:46:57 [auto1.de] INFO: Saving data for DG46200: {'auction_closing_time': 1774885611.0, 'created_time': 1774694165.857857, 'last_price_update_time': 1774781217.041988}
2026-03-29 10:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG46200') HTTP/1.1" 204 0
2026-03-29 10:46:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:46:57 [auto1.de] INFO: Found listing with ID: BU17582
2026-03-29 10:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU17582%27 HTTP/1.1" 200 None
2026-03-29 10:46:57 [auto1.de] INFO: Scrape type for BU17582: 2
2026-03-29 10:46:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad878d9e-b91e-5b5b-a2bf-8e7d9b7951dc with identifier: BU17582
2026-03-29 10:46:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad878d9e-b91e-5b5b-a2bf-8e7d9b7951dc with scrape type 2
2026-03-29 10:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad878d9e-b91e-5b5b-a2bf-8e7d9b7951dc with scrape type 2
2026-03-29 10:46:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ad878d9e-b91e-5b5b-a2bf-8e7d9b7951dc, identifier: BU17582
2026-03-29 10:46:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ad878d9e-b91e-5b5b-a2bf-8e7d9b7951dc with identifier: BU17582
2026-03-29 10:46:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ad878d9e-b91e-5b5b-a2bf-8e7d9b7951dc with identifier: BU17582
2026-03-29 10:46:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ad878d9e-b91e-5b5b-a2bf-8e7d9b7951dc with identifier: BU17582 to the API
2026-03-29 10:46:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:46:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:46:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:54:20Z',
 'fuel_type': 'petrol',
 'id': 'ad878d9e-b91e-5b5b-a2bf-8e7d9b7951dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU17582',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 67413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-16',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 T4 Momentum Pro 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum Pro 2WD',
 'year': 2019}
2026-03-29 10:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU17582%27 HTTP/1.1" 200 None
2026-03-29 10:46:57 [auto1.de] INFO: Saving data for BU17582: {'auction_closing_time': 1774886060.0, 'created_time': 1774033778.877449, 'last_price_update_time': 1774781217.54381}
2026-03-29 10:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU17582') HTTP/1.1" 204 0
2026-03-29 10:46:57 [auto1.de] INFO: Found listing with ID: HN71880
2026-03-29 10:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN71880%27 HTTP/1.1" 200 None
2026-03-29 10:46:57 [auto1.de] INFO: Scrape type for HN71880: 2
2026-03-29 10:46:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46e8c254-7c22-5967-8026-a6e882764890 with identifier: HN71880
2026-03-29 10:46:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46e8c254-7c22-5967-8026-a6e882764890 with scrape type 2
2026-03-29 10:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46e8c254-7c22-5967-8026-a6e882764890 with scrape type 2
2026-03-29 10:46:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46e8c254-7c22-5967-8026-a6e882764890, identifier: HN71880
2026-03-29 10:46:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46e8c254-7c22-5967-8026-a6e882764890 with identifier: HN71880
2026-03-29 10:46:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46e8c254-7c22-5967-8026-a6e882764890 with identifier: HN71880
2026-03-29 10:46:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46e8c254-7c22-5967-8026-a6e882764890 with identifier: HN71880 to the API
2026-03-29 10:46:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:46:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:46:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:04:04Z',
 'fuel_type': 'petrol',
 'id': '46e8c254-7c22-5967-8026-a6e882764890',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN71880',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 122855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-08',
 'seller_name': None,
 'title': "Renault Megane 1.6 Je t'aime",
 'transmission': 'manual',
 'trim': "Je t'aime",
 'year': 2011}
2026-03-29 10:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN71880%27 HTTP/1.1" 200 None
2026-03-29 10:46:57 [auto1.de] INFO: Saving data for HN71880: {'auction_closing_time': 1774883044.0, 'created_time': 1774694180.024189, 'last_price_update_time': 1774781217.955566}
2026-03-29 10:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HN71880') HTTP/1.1" 204 0
2026-03-29 10:46:57 [auto1.de] INFO: Found listing with ID: VN03026
2026-03-29 10:46:57 [auto1.de] INFO: Found listing with ID: NS77188
2026-03-29 10:46:57 [auto1.de] INFO: Found listing with ID: GT32005
2026-03-29 10:46:57 [auto1.de] INFO: Found listing with ID: UT62888
2026-03-29 10:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT62888%27 HTTP/1.1" 200 None
2026-03-29 10:46:57 [auto1.de] INFO: Scrape type for UT62888: 2
2026-03-29 10:46:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65718b7a-816f-50fb-9360-dbd5b4eeb25f with identifier: UT62888
2026-03-29 10:46:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65718b7a-816f-50fb-9360-dbd5b4eeb25f with scrape type 2
2026-03-29 10:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65718b7a-816f-50fb-9360-dbd5b4eeb25f with scrape type 2
2026-03-29 10:46:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65718b7a-816f-50fb-9360-dbd5b4eeb25f, identifier: UT62888
2026-03-29 10:46:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65718b7a-816f-50fb-9360-dbd5b4eeb25f with identifier: UT62888
2026-03-29 10:46:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65718b7a-816f-50fb-9360-dbd5b4eeb25f with identifier: UT62888
2026-03-29 10:46:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65718b7a-816f-50fb-9360-dbd5b4eeb25f with identifier: UT62888 to the API
2026-03-29 10:46:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:46:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:46:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:39:12Z',
 'fuel_type': 'diesel',
 'id': '65718b7a-816f-50fb-9360-dbd5b4eeb25f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT62888',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 114198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-24',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 110 CDI FWD lang',
 'transmission': 'automatic',
 'trim': 'FWD lang',
 'year': 2021}
2026-03-29 10:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT62888%27 HTTP/1.1" 200 None
2026-03-29 10:46:58 [auto1.de] INFO: Saving data for UT62888: {'auction_closing_time': 1774885152.0, 'created_time': 1774380418.96552, 'last_price_update_time': 1774781218.383321}
2026-03-29 10:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UT62888') HTTP/1.1" 204 0
2026-03-29 10:46:58 [auto1.de] INFO: Found listing with ID: CN24608
2026-03-29 10:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN24608%27 HTTP/1.1" 200 None
2026-03-29 10:46:58 [auto1.de] INFO: Scrape type for CN24608: 2
2026-03-29 10:46:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d with identifier: CN24608
2026-03-29 10:46:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d with scrape type 2
2026-03-29 10:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d with scrape type 2
2026-03-29 10:46:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d, identifier: CN24608
2026-03-29 10:46:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d with identifier: CN24608
2026-03-29 10:46:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d with identifier: CN24608
2026-03-29 10:46:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d with identifier: CN24608 to the API
2026-03-29 10:46:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:46:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:46:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:51:54Z',
 'fuel_type': 'diesel',
 'id': '30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN24608',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 276222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-30',
 'seller_name': None,
 'title': 'Honda Civic 2.2 CTDI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2008}
2026-03-29 10:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN24608%27 HTTP/1.1" 200 None
2026-03-29 10:46:58 [auto1.de] INFO: Saving data for CN24608: {'auction_closing_time': 1774885914.0, 'created_time': 1774694349.374981, 'last_price_update_time': 1774781218.794565}
2026-03-29 10:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CN24608') HTTP/1.1" 204 0
2026-03-29 10:46:58 [auto1.de] INFO: Found listing with ID: BE39564
2026-03-29 10:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE39564%27 HTTP/1.1" 200 None
2026-03-29 10:46:58 [auto1.de] INFO: Scrape type for BE39564: 2
2026-03-29 10:46:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dae1123b-22f1-50a4-9708-3b1358d76717 with identifier: BE39564
2026-03-29 10:46:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dae1123b-22f1-50a4-9708-3b1358d76717 with scrape type 2
2026-03-29 10:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dae1123b-22f1-50a4-9708-3b1358d76717 with scrape type 2
2026-03-29 10:46:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dae1123b-22f1-50a4-9708-3b1358d76717, identifier: BE39564
2026-03-29 10:46:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dae1123b-22f1-50a4-9708-3b1358d76717 with identifier: BE39564
2026-03-29 10:46:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dae1123b-22f1-50a4-9708-3b1358d76717 with identifier: BE39564
2026-03-29 10:46:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dae1123b-22f1-50a4-9708-3b1358d76717 with identifier: BE39564 to the API
2026-03-29 10:46:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:46:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:46:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:52:33Z',
 'fuel_type': 'diesel',
 'id': 'dae1123b-22f1-50a4-9708-3b1358d76717',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE39564',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 347895,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-23',
 'seller_name': None,
 'title': 'Volvo V60 2.0 D3 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2014}
2026-03-29 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE39564%27 HTTP/1.1" 200 None
2026-03-29 10:46:59 [auto1.de] INFO: Saving data for BE39564: {'auction_closing_time': 1774885953.0, 'created_time': 1774694169.601926, 'last_price_update_time': 1774781219.209582}
2026-03-29 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE39564') HTTP/1.1" 204 0
2026-03-29 10:46:59 [auto1.de] INFO: Found listing with ID: SF89930
2026-03-29 10:46:59 [auto1.de] INFO: Found listing with ID: FF09080
2026-03-29 10:46:59 [auto1.de] INFO: Found listing with ID: XU36975
2026-03-29 10:46:59 [auto1.de] INFO: Found listing with ID: WV82579
2026-03-29 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV82579%27 HTTP/1.1" 200 None
2026-03-29 10:46:59 [auto1.de] INFO: Scrape type for WV82579: 2
2026-03-29 10:46:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32fd4dcc-6f40-5219-9e5a-a86bc1acd48d with identifier: WV82579
2026-03-29 10:46:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32fd4dcc-6f40-5219-9e5a-a86bc1acd48d with scrape type 2
2026-03-29 10:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32fd4dcc-6f40-5219-9e5a-a86bc1acd48d with scrape type 2
2026-03-29 10:46:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32fd4dcc-6f40-5219-9e5a-a86bc1acd48d, identifier: WV82579
2026-03-29 10:46:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32fd4dcc-6f40-5219-9e5a-a86bc1acd48d with identifier: WV82579
2026-03-29 10:46:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32fd4dcc-6f40-5219-9e5a-a86bc1acd48d with identifier: WV82579
2026-03-29 10:46:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32fd4dcc-6f40-5219-9e5a-a86bc1acd48d with identifier: WV82579 to the API
2026-03-29 10:46:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:46:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:46:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:39:10Z',
 'fuel_type': 'petrol',
 'id': '32fd4dcc-6f40-5219-9e5a-a86bc1acd48d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV82579',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 198919,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-16',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2014}
2026-03-29 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV82579%27 HTTP/1.1" 200 None
2026-03-29 10:46:59 [auto1.de] INFO: Saving data for WV82579: {'auction_closing_time': 1774885150.0, 'created_time': 1774694353.584955, 'last_price_update_time': 1774781219.642951}
2026-03-29 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WV82579') HTTP/1.1" 204 0
2026-03-29 10:46:59 [auto1.de] INFO: Found listing with ID: NF23902
2026-03-29 10:46:59 [auto1.de] INFO: Found listing with ID: ZP80469
2026-03-29 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP80469%27 HTTP/1.1" 200 None
2026-03-29 10:46:59 [auto1.de] INFO: Scrape type for ZP80469: 2
2026-03-29 10:46:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54f9a65b-b0b4-5940-8897-00099051e33e with identifier: ZP80469
2026-03-29 10:46:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54f9a65b-b0b4-5940-8897-00099051e33e with scrape type 2
2026-03-29 10:46:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54f9a65b-b0b4-5940-8897-00099051e33e with scrape type 2
2026-03-29 10:46:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54f9a65b-b0b4-5940-8897-00099051e33e, identifier: ZP80469
2026-03-29 10:46:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54f9a65b-b0b4-5940-8897-00099051e33e with identifier: ZP80469
2026-03-29 10:46:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54f9a65b-b0b4-5940-8897-00099051e33e with identifier: ZP80469
2026-03-29 10:46:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54f9a65b-b0b4-5940-8897-00099051e33e with identifier: ZP80469 to the API
2026-03-29 10:46:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:47:21Z',
 'fuel_type': 'petrol',
 'id': '54f9a65b-b0b4-5940-8897-00099051e33e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP80469',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 118029,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-13',
 'seller_name': None,
 'title': 'Suzuki Vitara 1.4 BoosterJet Comfort + 4x4',
 'transmission': 'automatic',
 'trim': 'Comfort + 4x4',
 'year': 2018}
2026-03-29 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP80469%27 HTTP/1.1" 200 None
2026-03-29 10:47:00 [auto1.de] INFO: Saving data for ZP80469: {'auction_closing_time': 1774885641.0, 'created_time': 1773381260.065967, 'last_price_update_time': 1774781220.227789}
2026-03-29 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZP80469') HTTP/1.1" 204 0
2026-03-29 10:47:00 [auto1.de] INFO: Found listing with ID: TR04886
2026-03-29 10:47:00 [auto1.de] INFO: Found listing with ID: CW56448
2026-03-29 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW56448%27 HTTP/1.1" 200 None
2026-03-29 10:47:00 [auto1.de] INFO: Scrape type for CW56448: 2
2026-03-29 10:47:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6249825-b358-5ffd-997c-66c5ec00f94d with identifier: CW56448
2026-03-29 10:47:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6249825-b358-5ffd-997c-66c5ec00f94d with scrape type 2
2026-03-29 10:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6249825-b358-5ffd-997c-66c5ec00f94d with scrape type 2
2026-03-29 10:47:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c6249825-b358-5ffd-997c-66c5ec00f94d, identifier: CW56448
2026-03-29 10:47:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c6249825-b358-5ffd-997c-66c5ec00f94d with identifier: CW56448
2026-03-29 10:47:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c6249825-b358-5ffd-997c-66c5ec00f94d with identifier: CW56448
2026-03-29 10:47:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c6249825-b358-5ffd-997c-66c5ec00f94d with identifier: CW56448 to the API
2026-03-29 10:47:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:40:55Z',
 'fuel_type': 'diesel',
 'id': 'c6249825-b358-5ffd-997c-66c5ec00f94d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW56448',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 80034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-17',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 dCi 360',
 'transmission': 'automatic',
 'trim': '360',
 'year': 2015}
2026-03-29 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW56448%27 HTTP/1.1" 200 None
2026-03-29 10:47:00 [auto1.de] INFO: Saving data for CW56448: {'auction_closing_time': 1774885255.0, 'created_time': 1774694168.496588, 'last_price_update_time': 1774781220.653951}
2026-03-29 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW56448') HTTP/1.1" 204 0
2026-03-29 10:47:00 [auto1.de] INFO: Found listing with ID: DL34972
2026-03-29 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL34972%27 HTTP/1.1" 200 None
2026-03-29 10:47:00 [auto1.de] INFO: Scrape type for DL34972: 2
2026-03-29 10:47:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df46b9d6-a35b-5d8f-b100-3abb90134705 with identifier: DL34972
2026-03-29 10:47:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df46b9d6-a35b-5d8f-b100-3abb90134705 with scrape type 2
2026-03-29 10:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df46b9d6-a35b-5d8f-b100-3abb90134705 with scrape type 2
2026-03-29 10:47:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df46b9d6-a35b-5d8f-b100-3abb90134705, identifier: DL34972
2026-03-29 10:47:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df46b9d6-a35b-5d8f-b100-3abb90134705 with identifier: DL34972
2026-03-29 10:47:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df46b9d6-a35b-5d8f-b100-3abb90134705 with identifier: DL34972
2026-03-29 10:47:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df46b9d6-a35b-5d8f-b100-3abb90134705 with identifier: DL34972 to the API
2026-03-29 10:47:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:03:17Z',
 'fuel_type': 'petrol',
 'id': 'df46b9d6-a35b-5d8f-b100-3abb90134705',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL34972',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i40',
 'odometer': 161127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-02',
 'seller_name': None,
 'title': 'Hyundai i40 1.6 Trend Blue',
 'transmission': 'manual',
 'trim': 'Trend Blue',
 'year': 2017}
2026-03-29 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL34972%27 HTTP/1.1" 200 None
2026-03-29 10:47:01 [auto1.de] INFO: Saving data for DL34972: {'auction_closing_time': 1774882997.0, 'created_time': 1773427051.394267, 'last_price_update_time': 1774781221.112391}
2026-03-29 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DL34972') HTTP/1.1" 204 0
2026-03-29 10:47:01 [auto1.de] INFO: Found listing with ID: JR73784
2026-03-29 10:47:01 [auto1.de] INFO: Found listing with ID: TK15682
2026-03-29 10:47:01 [auto1.de] INFO: Found listing with ID: ZD10006
2026-03-29 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD10006%27 HTTP/1.1" 200 None
2026-03-29 10:47:01 [auto1.de] INFO: Scrape type for ZD10006: 2
2026-03-29 10:47:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 179f74e2-e4af-5acb-99fb-b8a56a7d87c8 with identifier: ZD10006
2026-03-29 10:47:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 179f74e2-e4af-5acb-99fb-b8a56a7d87c8 with scrape type 2
2026-03-29 10:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 179f74e2-e4af-5acb-99fb-b8a56a7d87c8 with scrape type 2
2026-03-29 10:47:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 179f74e2-e4af-5acb-99fb-b8a56a7d87c8, identifier: ZD10006
2026-03-29 10:47:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 179f74e2-e4af-5acb-99fb-b8a56a7d87c8 with identifier: ZD10006
2026-03-29 10:47:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 179f74e2-e4af-5acb-99fb-b8a56a7d87c8 with identifier: ZD10006
2026-03-29 10:47:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 179f74e2-e4af-5acb-99fb-b8a56a7d87c8 with identifier: ZD10006 to the API
2026-03-29 10:47:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:21:36Z',
 'fuel_type': 'petrol',
 'id': '179f74e2-e4af-5acb-99fb-b8a56a7d87c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD10006',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 132301,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-09',
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-29 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD10006%27 HTTP/1.1" 200 None
2026-03-29 10:47:01 [auto1.de] INFO: Saving data for ZD10006: {'auction_closing_time': 1774884096.0, 'created_time': 1774694200.971985, 'last_price_update_time': 1774781221.510724}
2026-03-29 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD10006') HTTP/1.1" 204 0
2026-03-29 10:47:01 [auto1.de] INFO: Found listing with ID: FX32904
2026-03-29 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX32904%27 HTTP/1.1" 200 None
2026-03-29 10:47:01 [auto1.de] INFO: Scrape type for FX32904: 2
2026-03-29 10:47:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83a13b29-1f3b-5e38-82de-d63f81df926d with identifier: FX32904
2026-03-29 10:47:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83a13b29-1f3b-5e38-82de-d63f81df926d with scrape type 2
2026-03-29 10:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83a13b29-1f3b-5e38-82de-d63f81df926d with scrape type 2
2026-03-29 10:47:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83a13b29-1f3b-5e38-82de-d63f81df926d, identifier: FX32904
2026-03-29 10:47:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:47:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83a13b29-1f3b-5e38-82de-d63f81df926d with identifier: FX32904
2026-03-29 10:47:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83a13b29-1f3b-5e38-82de-d63f81df926d with identifier: FX32904
2026-03-29 10:47:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83a13b29-1f3b-5e38-82de-d63f81df926d with identifier: FX32904 to the API
2026-03-29 10:47:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:10:55Z',
 'fuel_type': 'petrol',
 'id': '83a13b29-1f3b-5e38-82de-d63f81df926d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX32904',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 122294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-08-30',
 'seller_name': None,
 'title': 'Hyundai Tucson 2.0 GLS',
 'transmission': 'manual',
 'trim': 'GLS',
 'year': 2004}
2026-03-29 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX32904%27 HTTP/1.1" 200 None
2026-03-29 10:47:01 [auto1.de] INFO: Saving data for FX32904: {'auction_closing_time': 1774883455.0, 'created_time': 1774694347.458179, 'last_price_update_time': 1774781221.885665}
2026-03-29 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX32904') HTTP/1.1" 204 0
2026-03-29 10:47:01 [auto1.de] INFO: Found listing with ID: DT59270
2026-03-29 10:47:01 [auto1.de] INFO: Found listing with ID: SD29600
2026-03-29 10:47:01 [auto1.de] INFO: Channel: 24h | Page: 159 | totalHits: 6726 | hits on page: 40
2026-03-29 10:47:01 [auto1.de] INFO: Found listing with ID: AY51976
2026-03-29 10:47:01 [auto1.de] INFO: Found listing with ID: PB79978
2026-03-29 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB79978%27 HTTP/1.1" 200 None
2026-03-29 10:47:01 [auto1.de] INFO: Scrape type for PB79978: 2
2026-03-29 10:47:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 935cdd8d-12b7-5c60-b749-5efc19aed1d9 with identifier: PB79978
2026-03-29 10:47:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 935cdd8d-12b7-5c60-b749-5efc19aed1d9 with scrape type 2
2026-03-29 10:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 935cdd8d-12b7-5c60-b749-5efc19aed1d9 with scrape type 2
2026-03-29 10:47:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 935cdd8d-12b7-5c60-b749-5efc19aed1d9, identifier: PB79978
2026-03-29 10:47:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 935cdd8d-12b7-5c60-b749-5efc19aed1d9 with identifier: PB79978
2026-03-29 10:47:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 935cdd8d-12b7-5c60-b749-5efc19aed1d9 with identifier: PB79978
2026-03-29 10:47:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 935cdd8d-12b7-5c60-b749-5efc19aed1d9 with identifier: PB79978 to the API
2026-03-29 10:47:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:39:12Z',
 'fuel_type': 'petrol',
 'id': '935cdd8d-12b7-5c60-b749-5efc19aed1d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB79978',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 88914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-28',
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2017}
2026-03-29 10:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB79978%27 HTTP/1.1" 200 None
2026-03-29 10:47:02 [auto1.de] INFO: Saving data for PB79978: {'auction_closing_time': 1774885152.0, 'created_time': 1774694352.142157, 'last_price_update_time': 1774781222.305773}
2026-03-29 10:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB79978') HTTP/1.1" 204 0
2026-03-29 10:47:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:47:02 [auto1.de] INFO: Found listing with ID: KT35256
2026-03-29 10:47:02 [auto1.de] INFO: Found listing with ID: ZY39038
2026-03-29 10:47:02 [auto1.de] INFO: Found listing with ID: SX18437
2026-03-29 10:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX18437%27 HTTP/1.1" 200 None
2026-03-29 10:47:02 [auto1.de] INFO: Scrape type for SX18437: 2
2026-03-29 10:47:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08505e1b-1ad2-576d-a433-f2885f6dfcfc with identifier: SX18437
2026-03-29 10:47:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08505e1b-1ad2-576d-a433-f2885f6dfcfc with scrape type 2
2026-03-29 10:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08505e1b-1ad2-576d-a433-f2885f6dfcfc with scrape type 2
2026-03-29 10:47:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08505e1b-1ad2-576d-a433-f2885f6dfcfc, identifier: SX18437
2026-03-29 10:47:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08505e1b-1ad2-576d-a433-f2885f6dfcfc with identifier: SX18437
2026-03-29 10:47:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08505e1b-1ad2-576d-a433-f2885f6dfcfc with identifier: SX18437
2026-03-29 10:47:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08505e1b-1ad2-576d-a433-f2885f6dfcfc with identifier: SX18437 to the API
2026-03-29 10:47:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 72,
 'expiration_date': '2026-03-30T15:01:49Z',
 'fuel_type': 'petrol',
 'id': '08505e1b-1ad2-576d-a433-f2885f6dfcfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX18437',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '108',
 'odometer': 29420,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-04-20',
 'seller_name': None,
 'title': 'Peugeot 108 1.0 VTi TOP Collection',
 'transmission': 'manual',
 'trim': 'TOP Collection',
 'year': 2020}
2026-03-29 10:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX18437%27 HTTP/1.1" 200 None
2026-03-29 10:47:02 [auto1.de] INFO: Saving data for SX18437: {'auction_closing_time': 1774882909.0, 'created_time': 1774694198.402438, 'last_price_update_time': 1774781222.825409}
2026-03-29 10:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX18437') HTTP/1.1" 204 0
2026-03-29 10:47:02 [auto1.de] INFO: Found listing with ID: EA52308
2026-03-29 10:47:02 [auto1.de] INFO: Found listing with ID: KD45426
2026-03-29 10:47:02 [auto1.de] INFO: Found listing with ID: VZ43833
2026-03-29 10:47:02 [auto1.de] INFO: Found listing with ID: HA56884
2026-03-29 10:47:02 [auto1.de] INFO: Found listing with ID: FD80393
2026-03-29 10:47:02 [auto1.de] INFO: Found listing with ID: GF30877
2026-03-29 10:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF30877%27 HTTP/1.1" 200 None
2026-03-29 10:47:02 [auto1.de] INFO: Scrape type for GF30877: 2
2026-03-29 10:47:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3a6b116-b784-5c90-b66e-ba9ca30b5cf9 with identifier: GF30877
2026-03-29 10:47:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3a6b116-b784-5c90-b66e-ba9ca30b5cf9 with scrape type 2
2026-03-29 10:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3a6b116-b784-5c90-b66e-ba9ca30b5cf9 with scrape type 2
2026-03-29 10:47:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e3a6b116-b784-5c90-b66e-ba9ca30b5cf9, identifier: GF30877
2026-03-29 10:47:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e3a6b116-b784-5c90-b66e-ba9ca30b5cf9 with identifier: GF30877
2026-03-29 10:47:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e3a6b116-b784-5c90-b66e-ba9ca30b5cf9 with identifier: GF30877
2026-03-29 10:47:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e3a6b116-b784-5c90-b66e-ba9ca30b5cf9 with identifier: GF30877 to the API
2026-03-29 10:47:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:22:32Z',
 'fuel_type': 'diesel',
 'id': 'e3a6b116-b784-5c90-b66e-ba9ca30b5cf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF30877',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 125395,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-25',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2019}
2026-03-29 10:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF30877%27 HTTP/1.1" 200 None
2026-03-29 10:47:03 [auto1.de] INFO: Saving data for GF30877: {'auction_closing_time': 1774884152.0, 'created_time': 1773946982.55872, 'last_price_update_time': 1774781223.258403}
2026-03-29 10:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF30877') HTTP/1.1" 204 0
2026-03-29 10:47:03 [auto1.de] INFO: Found listing with ID: CD84483
2026-03-29 10:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD84483%27 HTTP/1.1" 200 None
2026-03-29 10:47:03 [auto1.de] INFO: Scrape type for CD84483: 2
2026-03-29 10:47:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e101ba3c-90c9-5c5c-8ecf-c79eaaa6a9bb with identifier: CD84483
2026-03-29 10:47:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e101ba3c-90c9-5c5c-8ecf-c79eaaa6a9bb with scrape type 2
2026-03-29 10:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e101ba3c-90c9-5c5c-8ecf-c79eaaa6a9bb with scrape type 2
2026-03-29 10:47:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e101ba3c-90c9-5c5c-8ecf-c79eaaa6a9bb, identifier: CD84483
2026-03-29 10:47:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e101ba3c-90c9-5c5c-8ecf-c79eaaa6a9bb with identifier: CD84483
2026-03-29 10:47:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e101ba3c-90c9-5c5c-8ecf-c79eaaa6a9bb with identifier: CD84483
2026-03-29 10:47:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e101ba3c-90c9-5c5c-8ecf-c79eaaa6a9bb with identifier: CD84483 to the API
2026-03-29 10:47:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:41:49Z',
 'fuel_type': 'diesel',
 'id': 'e101ba3c-90c9-5c5c-8ecf-c79eaaa6a9bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD84483',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 191041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-20',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-29 10:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD84483%27 HTTP/1.1" 200 None
2026-03-29 10:47:03 [auto1.de] INFO: Saving data for CD84483: {'auction_closing_time': 1774885309.0, 'created_time': 1773383273.43793, 'last_price_update_time': 1774781223.678918}
2026-03-29 10:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CD84483') HTTP/1.1" 204 0
2026-03-29 10:47:03 [auto1.de] INFO: Found listing with ID: XB41121
2026-03-29 10:47:03 [auto1.de] INFO: Found listing with ID: GM88868
2026-03-29 10:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM88868%27 HTTP/1.1" 200 None
2026-03-29 10:47:03 [auto1.de] INFO: Scrape type for GM88868: 2
2026-03-29 10:47:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7129dd7-5d9c-58fd-a786-ca35f83a0ec9 with identifier: GM88868
2026-03-29 10:47:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7129dd7-5d9c-58fd-a786-ca35f83a0ec9 with scrape type 2
2026-03-29 10:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7129dd7-5d9c-58fd-a786-ca35f83a0ec9 with scrape type 2
2026-03-29 10:47:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7129dd7-5d9c-58fd-a786-ca35f83a0ec9, identifier: GM88868
2026-03-29 10:47:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7129dd7-5d9c-58fd-a786-ca35f83a0ec9 with identifier: GM88868
2026-03-29 10:47:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7129dd7-5d9c-58fd-a786-ca35f83a0ec9 with identifier: GM88868
2026-03-29 10:47:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7129dd7-5d9c-58fd-a786-ca35f83a0ec9 with identifier: GM88868 to the API
2026-03-29 10:47:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:39:52Z',
 'fuel_type': 'diesel',
 'id': 'c7129dd7-5d9c-58fd-a786-ca35f83a0ec9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM88868',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'ProAce Verso',
 'odometer': 122558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-26',
 'seller_name': None,
 'title': 'Toyota ProAce Verso 2.0 D-4D L1 Family Comfort',
 'transmission': 'automatic',
 'trim': 'L1 Family Comfort',
 'year': 2021}
2026-03-29 10:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM88868%27 HTTP/1.1" 200 None
2026-03-29 10:47:04 [auto1.de] INFO: Saving data for GM88868: {'auction_closing_time': 1774885192.0, 'created_time': 1773401101.469245, 'last_price_update_time': 1774781224.114016}
2026-03-29 10:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM88868') HTTP/1.1" 204 0
2026-03-29 10:47:04 [auto1.de] INFO: Found listing with ID: AT60125
2026-03-29 10:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT60125%27 HTTP/1.1" 200 None
2026-03-29 10:47:04 [auto1.de] INFO: Scrape type for AT60125: 2
2026-03-29 10:47:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7a90115-bf44-5b9d-b03f-a2efb7f94f77 with identifier: AT60125
2026-03-29 10:47:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7a90115-bf44-5b9d-b03f-a2efb7f94f77 with scrape type 2
2026-03-29 10:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7a90115-bf44-5b9d-b03f-a2efb7f94f77 with scrape type 2
2026-03-29 10:47:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7a90115-bf44-5b9d-b03f-a2efb7f94f77, identifier: AT60125
2026-03-29 10:47:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7a90115-bf44-5b9d-b03f-a2efb7f94f77 with identifier: AT60125
2026-03-29 10:47:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7a90115-bf44-5b9d-b03f-a2efb7f94f77 with identifier: AT60125
2026-03-29 10:47:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7a90115-bf44-5b9d-b03f-a2efb7f94f77 with identifier: AT60125 to the API
2026-03-29 10:47:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:50:55Z',
 'fuel_type': 'diesel',
 'id': 'd7a90115-bf44-5b9d-b03f-a2efb7f94f77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT60125',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 157868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-13',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-29 10:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT60125%27 HTTP/1.1" 200 None
2026-03-29 10:47:04 [auto1.de] INFO: Saving data for AT60125: {'auction_closing_time': 1774885855.0, 'created_time': 1774694188.487276, 'last_price_update_time': 1774781224.667163}
2026-03-29 10:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AT60125') HTTP/1.1" 204 0
2026-03-29 10:47:04 [auto1.de] INFO: Found listing with ID: WA47251
2026-03-29 10:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA47251%27 HTTP/1.1" 200 None
2026-03-29 10:47:04 [auto1.de] INFO: Scrape type for WA47251: 2
2026-03-29 10:47:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 016bcf8d-8f85-5ed7-9177-03a81ff48f2f with identifier: WA47251
2026-03-29 10:47:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 016bcf8d-8f85-5ed7-9177-03a81ff48f2f with scrape type 2
2026-03-29 10:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 016bcf8d-8f85-5ed7-9177-03a81ff48f2f with scrape type 2
2026-03-29 10:47:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 016bcf8d-8f85-5ed7-9177-03a81ff48f2f, identifier: WA47251
2026-03-29 10:47:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 016bcf8d-8f85-5ed7-9177-03a81ff48f2f with identifier: WA47251
2026-03-29 10:47:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 016bcf8d-8f85-5ed7-9177-03a81ff48f2f with identifier: WA47251
2026-03-29 10:47:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 016bcf8d-8f85-5ed7-9177-03a81ff48f2f with identifier: WA47251 to the API
2026-03-29 10:47:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:34:15Z',
 'fuel_type': 'petrol',
 'id': '016bcf8d-8f85-5ed7-9177-03a81ff48f2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA47251',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Verso-S',
 'odometer': 56588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-19',
 'seller_name': None,
 'title': 'Toyota Verso-S 1.33 Dual VVT-i Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2012}
2026-03-29 10:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA47251%27 HTTP/1.1" 200 None
2026-03-29 10:47:05 [auto1.de] INFO: Saving data for WA47251: {'auction_closing_time': 1774884855.0, 'created_time': 1774694235.697099, 'last_price_update_time': 1774781225.06724}
2026-03-29 10:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA47251') HTTP/1.1" 204 0
2026-03-29 10:47:05 [auto1.de] INFO: Found listing with ID: DA22909
2026-03-29 10:47:05 [auto1.de] INFO: Found listing with ID: RC64872
2026-03-29 10:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC64872%27 HTTP/1.1" 200 None
2026-03-29 10:47:05 [auto1.de] INFO: Scrape type for RC64872: 2
2026-03-29 10:47:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e64e4cb5-9aec-5664-97ce-719fbb0b1efa with identifier: RC64872
2026-03-29 10:47:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e64e4cb5-9aec-5664-97ce-719fbb0b1efa with scrape type 2
2026-03-29 10:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e64e4cb5-9aec-5664-97ce-719fbb0b1efa with scrape type 2
2026-03-29 10:47:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e64e4cb5-9aec-5664-97ce-719fbb0b1efa, identifier: RC64872
2026-03-29 10:47:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e64e4cb5-9aec-5664-97ce-719fbb0b1efa with identifier: RC64872
2026-03-29 10:47:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e64e4cb5-9aec-5664-97ce-719fbb0b1efa with identifier: RC64872
2026-03-29 10:47:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e64e4cb5-9aec-5664-97ce-719fbb0b1efa with identifier: RC64872 to the API
2026-03-29 10:47:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:54:48Z',
 'fuel_type': 'petrol',
 'id': 'e64e4cb5-9aec-5664-97ce-719fbb0b1efa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC64872',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 78284,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-15',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive passion',
 'year': 2008}
2026-03-29 10:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC64872%27 HTTP/1.1" 200 None
2026-03-29 10:47:05 [auto1.de] INFO: Saving data for RC64872: {'auction_closing_time': 1774886088.0, 'created_time': 1774694189.227025, 'last_price_update_time': 1774781225.473066}
2026-03-29 10:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC64872') HTTP/1.1" 204 0
2026-03-29 10:47:05 [auto1.de] INFO: Found listing with ID: GV73009
2026-03-29 10:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV73009%27 HTTP/1.1" 200 None
2026-03-29 10:47:05 [auto1.de] INFO: Scrape type for GV73009: 2
2026-03-29 10:47:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b835a100-c137-5ebc-a5a4-6858cd247fdd with identifier: GV73009
2026-03-29 10:47:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b835a100-c137-5ebc-a5a4-6858cd247fdd with scrape type 2
2026-03-29 10:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b835a100-c137-5ebc-a5a4-6858cd247fdd with scrape type 2
2026-03-29 10:47:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b835a100-c137-5ebc-a5a4-6858cd247fdd, identifier: GV73009
2026-03-29 10:47:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:47:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b835a100-c137-5ebc-a5a4-6858cd247fdd with identifier: GV73009
2026-03-29 10:47:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b835a100-c137-5ebc-a5a4-6858cd247fdd with identifier: GV73009
2026-03-29 10:47:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b835a100-c137-5ebc-a5a4-6858cd247fdd with identifier: GV73009 to the API
2026-03-29 10:47:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:02:00Z',
 'fuel_type': 'petrol',
 'id': 'b835a100-c137-5ebc-a5a4-6858cd247fdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV73009',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 65735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-22',
 'seller_name': None,
 'title': 'Seat Leon 1.5 TSI ACT FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2018}
2026-03-29 10:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV73009%27 HTTP/1.1" 200 None
2026-03-29 10:47:05 [auto1.de] INFO: Saving data for GV73009: {'auction_closing_time': 1774882920.0, 'created_time': 1774002126.769679, 'last_price_update_time': 1774781225.896087}
2026-03-29 10:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV73009') HTTP/1.1" 204 0
2026-03-29 10:47:05 [auto1.de] INFO: Found listing with ID: SR63291
2026-03-29 10:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR63291%27 HTTP/1.1" 200 None
2026-03-29 10:47:05 [auto1.de] INFO: Scrape type for SR63291: 2
2026-03-29 10:47:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7348ca3-e5e5-50cf-bd19-bbcfd3215afe with identifier: SR63291
2026-03-29 10:47:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7348ca3-e5e5-50cf-bd19-bbcfd3215afe with scrape type 2
2026-03-29 10:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7348ca3-e5e5-50cf-bd19-bbcfd3215afe with scrape type 2
2026-03-29 10:47:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7348ca3-e5e5-50cf-bd19-bbcfd3215afe, identifier: SR63291
2026-03-29 10:47:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7348ca3-e5e5-50cf-bd19-bbcfd3215afe with identifier: SR63291
2026-03-29 10:47:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7348ca3-e5e5-50cf-bd19-bbcfd3215afe with identifier: SR63291
2026-03-29 10:47:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7348ca3-e5e5-50cf-bd19-bbcfd3215afe with identifier: SR63291 to the API
2026-03-29 10:47:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:03:52Z',
 'fuel_type': 'petrol',
 'id': 'd7348ca3-e5e5-50cf-bd19-bbcfd3215afe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR63291',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 97387,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-15',
 'seller_name': None,
 'title': 'Fiat 500C 0.9 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2017}
2026-03-29 10:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR63291%27 HTTP/1.1" 200 None
2026-03-29 10:47:06 [auto1.de] INFO: Saving data for SR63291: {'auction_closing_time': 1774883032.0, 'created_time': 1774032247.76233, 'last_price_update_time': 1774781226.355056}
2026-03-29 10:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR63291') HTTP/1.1" 204 0
2026-03-29 10:47:06 [auto1.de] INFO: Found listing with ID: BF10429
2026-03-29 10:47:06 [auto1.de] INFO: Found listing with ID: EP03101
2026-03-29 10:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP03101%27 HTTP/1.1" 200 None
2026-03-29 10:47:06 [auto1.de] INFO: Scrape type for EP03101: 2
2026-03-29 10:47:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efb5dc92-ba1e-529c-ad3b-24ef5caca626 with identifier: EP03101
2026-03-29 10:47:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efb5dc92-ba1e-529c-ad3b-24ef5caca626 with scrape type 2
2026-03-29 10:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efb5dc92-ba1e-529c-ad3b-24ef5caca626 with scrape type 2
2026-03-29 10:47:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: efb5dc92-ba1e-529c-ad3b-24ef5caca626, identifier: EP03101
2026-03-29 10:47:06 [scrapy.extensions.logstats] INFO: Crawled 222 pages (at 23 pages/min), scraped 285 items (at 24 items/min)
2026-03-29 10:47:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 160MiB
2026-03-29 10:47:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: efb5dc92-ba1e-529c-ad3b-24ef5caca626 with identifier: EP03101
2026-03-29 10:47:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: efb5dc92-ba1e-529c-ad3b-24ef5caca626 with identifier: EP03101
2026-03-29 10:47:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: efb5dc92-ba1e-529c-ad3b-24ef5caca626 with identifier: EP03101 to the API
2026-03-29 10:47:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:26:13Z',
 'fuel_type': 'diesel',
 'id': 'efb5dc92-ba1e-529c-ad3b-24ef5caca626',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP03101',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 162474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-15',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 2.0 CDTI Innovation Start/Stop',
 'transmission': 'manual',
 'trim': 'Innovation Start/Stop',
 'year': 2017}
2026-03-29 10:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP03101%27 HTTP/1.1" 200 None
2026-03-29 10:47:06 [auto1.de] INFO: Saving data for EP03101: {'auction_closing_time': 1774884373.0, 'created_time': 1774694237.621273, 'last_price_update_time': 1774781226.795221}
2026-03-29 10:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EP03101') HTTP/1.1" 204 0
2026-03-29 10:47:06 [auto1.de] INFO: Channel: 24h | Page: 160 | totalHits: 6726 | hits on page: 40
2026-03-29 10:47:06 [auto1.de] INFO: Found listing with ID: XY13632
2026-03-29 10:47:06 [auto1.de] INFO: Found listing with ID: HA64256
2026-03-29 10:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA64256%27 HTTP/1.1" 200 None
2026-03-29 10:47:06 [auto1.de] INFO: Scrape type for HA64256: 2
2026-03-29 10:47:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5b16257-e87c-536c-81c4-4eac4e3c9c7b with identifier: HA64256
2026-03-29 10:47:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5b16257-e87c-536c-81c4-4eac4e3c9c7b with scrape type 2
2026-03-29 10:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5b16257-e87c-536c-81c4-4eac4e3c9c7b with scrape type 2
2026-03-29 10:47:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e5b16257-e87c-536c-81c4-4eac4e3c9c7b, identifier: HA64256
2026-03-29 10:47:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e5b16257-e87c-536c-81c4-4eac4e3c9c7b with identifier: HA64256
2026-03-29 10:47:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e5b16257-e87c-536c-81c4-4eac4e3c9c7b with identifier: HA64256
2026-03-29 10:47:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e5b16257-e87c-536c-81c4-4eac4e3c9c7b with identifier: HA64256 to the API
2026-03-29 10:47:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:45:07Z',
 'fuel_type': 'diesel',
 'id': 'e5b16257-e87c-536c-81c4-4eac4e3c9c7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA64256',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 230787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-21',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium S',
 'transmission': 'manual',
 'trim': 'Titanium S',
 'year': 2013}
2026-03-29 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA64256%27 HTTP/1.1" 200 None
2026-03-29 10:47:07 [auto1.de] INFO: Saving data for HA64256: {'auction_closing_time': 1774885507.0, 'created_time': 1774694202.404007, 'last_price_update_time': 1774781227.386735}
2026-03-29 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA64256') HTTP/1.1" 204 0
2026-03-29 10:47:07 [auto1.de] INFO: Found listing with ID: RR37288
2026-03-29 10:47:07 [auto1.de] INFO: Found listing with ID: ZG46471
2026-03-29 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG46471%27 HTTP/1.1" 200 None
2026-03-29 10:47:07 [auto1.de] INFO: Scrape type for ZG46471: 2
2026-03-29 10:47:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2bcd83c-a27a-55fa-984e-91e5916927ba with identifier: ZG46471
2026-03-29 10:47:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2bcd83c-a27a-55fa-984e-91e5916927ba with scrape type 2
2026-03-29 10:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2bcd83c-a27a-55fa-984e-91e5916927ba with scrape type 2
2026-03-29 10:47:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2bcd83c-a27a-55fa-984e-91e5916927ba, identifier: ZG46471
2026-03-29 10:47:07 [auto1.de] INFO: Found listing with ID: BH34221
2026-03-29 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH34221%27 HTTP/1.1" 200 None
2026-03-29 10:47:07 [auto1.de] INFO: Scrape type for BH34221: 2
2026-03-29 10:47:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e with identifier: BH34221
2026-03-29 10:47:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e with scrape type 2
2026-03-29 10:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e with scrape type 2
2026-03-29 10:47:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e, identifier: BH34221
2026-03-29 10:47:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2bcd83c-a27a-55fa-984e-91e5916927ba with identifier: ZG46471
2026-03-29 10:47:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2bcd83c-a27a-55fa-984e-91e5916927ba with identifier: ZG46471
2026-03-29 10:47:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2bcd83c-a27a-55fa-984e-91e5916927ba with identifier: ZG46471 to the API
2026-03-29 10:47:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:00:37Z',
 'fuel_type': 'petrol',
 'id': 'b2bcd83c-a27a-55fa-984e-91e5916927ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG46471',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Orlando',
 'odometer': 113922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-01',
 'seller_name': None,
 'title': 'Chevrolet Orlando 1.8 LT',
 'transmission': 'manual',
 'trim': 'LT',
 'year': 2012}
2026-03-29 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG46471%27 HTTP/1.1" 200 None
2026-03-29 10:47:07 [auto1.de] INFO: Saving data for ZG46471: {'auction_closing_time': 1774882837.0, 'created_time': 1774035345.555718, 'last_price_update_time': 1774781227.915327}
2026-03-29 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG46471') HTTP/1.1" 204 0
2026-03-29 10:47:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:47:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e with identifier: BH34221
2026-03-29 10:47:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e with identifier: BH34221
2026-03-29 10:47:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e with identifier: BH34221 to the API
2026-03-29 10:47:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:27:16Z',
 'fuel_type': 'petrol',
 'id': 'a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH34221',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 89105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1994-07-31',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Joy',
 'transmission': 'automatic',
 'trim': 'Joy',
 'year': 1994}
2026-03-29 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH34221%27 HTTP/1.1" 200 None
2026-03-29 10:47:08 [auto1.de] INFO: Saving data for BH34221: {'auction_closing_time': 1774884436.0, 'created_time': 1774694212.743347, 'last_price_update_time': 1774781228.332968}
2026-03-29 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH34221') HTTP/1.1" 204 0
2026-03-29 10:47:08 [auto1.de] INFO: Found listing with ID: ZR61272
2026-03-29 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR61272%27 HTTP/1.1" 200 None
2026-03-29 10:47:08 [auto1.de] INFO: Scrape type for ZR61272: 2
2026-03-29 10:47:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcb4f497-9e25-55a0-b724-bb623217da7d with identifier: ZR61272
2026-03-29 10:47:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcb4f497-9e25-55a0-b724-bb623217da7d with scrape type 2
2026-03-29 10:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bcb4f497-9e25-55a0-b724-bb623217da7d with scrape type 2
2026-03-29 10:47:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bcb4f497-9e25-55a0-b724-bb623217da7d, identifier: ZR61272
2026-03-29 10:47:08 [auto1.de] INFO: Found listing with ID: MH64159
2026-03-29 10:47:08 [auto1.de] INFO: Found listing with ID: CU51280
2026-03-29 10:47:08 [auto1.de] INFO: Found listing with ID: PT22331
2026-03-29 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT22331%27 HTTP/1.1" 200 None
2026-03-29 10:47:08 [auto1.de] INFO: Scrape type for PT22331: 2
2026-03-29 10:47:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f153be52-7eed-5477-8858-c6eb7905279c with identifier: PT22331
2026-03-29 10:47:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f153be52-7eed-5477-8858-c6eb7905279c with scrape type 2
2026-03-29 10:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f153be52-7eed-5477-8858-c6eb7905279c with scrape type 2
2026-03-29 10:47:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f153be52-7eed-5477-8858-c6eb7905279c, identifier: PT22331
2026-03-29 10:47:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bcb4f497-9e25-55a0-b724-bb623217da7d with identifier: ZR61272
2026-03-29 10:47:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bcb4f497-9e25-55a0-b724-bb623217da7d with identifier: ZR61272
2026-03-29 10:47:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bcb4f497-9e25-55a0-b724-bb623217da7d with identifier: ZR61272 to the API
2026-03-29 10:47:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:26:41Z',
 'fuel_type': 'diesel',
 'id': 'bcb4f497-9e25-55a0-b724-bb623217da7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR61272',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 207080,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-29',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 CDI Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2014}
2026-03-29 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR61272%27 HTTP/1.1" 200 None
2026-03-29 10:47:08 [auto1.de] INFO: Saving data for ZR61272: {'auction_closing_time': 1774884401.0, 'created_time': 1774694320.306227, 'last_price_update_time': 1774781228.840168}
2026-03-29 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZR61272') HTTP/1.1" 204 0
2026-03-29 10:47:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f153be52-7eed-5477-8858-c6eb7905279c with identifier: PT22331
2026-03-29 10:47:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f153be52-7eed-5477-8858-c6eb7905279c with identifier: PT22331
2026-03-29 10:47:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f153be52-7eed-5477-8858-c6eb7905279c with identifier: PT22331 to the API
2026-03-29 10:47:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:43:51Z',
 'fuel_type': 'petrol',
 'id': 'f153be52-7eed-5477-8858-c6eb7905279c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT22331',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 132789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-27',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Urban',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Urban',
 'year': 2013}
2026-03-29 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT22331%27 HTTP/1.1" 200 None
2026-03-29 10:47:09 [auto1.de] INFO: Saving data for PT22331: {'auction_closing_time': 1774885431.0, 'created_time': 1773398777.031536, 'last_price_update_time': 1774781229.146416}
2026-03-29 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PT22331') HTTP/1.1" 204 0
2026-03-29 10:47:09 [auto1.de] INFO: Found listing with ID: XL20163
2026-03-29 10:47:09 [auto1.de] INFO: Found listing with ID: YU16554
2026-03-29 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU16554%27 HTTP/1.1" 200 None
2026-03-29 10:47:09 [auto1.de] INFO: Scrape type for YU16554: 2
2026-03-29 10:47:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 984a1914-17a6-5a58-b562-c04073490779 with identifier: YU16554
2026-03-29 10:47:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 984a1914-17a6-5a58-b562-c04073490779 with scrape type 2
2026-03-29 10:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 984a1914-17a6-5a58-b562-c04073490779 with scrape type 2
2026-03-29 10:47:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 984a1914-17a6-5a58-b562-c04073490779, identifier: YU16554
2026-03-29 10:47:09 [auto1.de] INFO: Found listing with ID: TS47391
2026-03-29 10:47:09 [auto1.de] INFO: Found listing with ID: JD30879
2026-03-29 10:47:09 [auto1.de] INFO: Found listing with ID: BC15764
2026-03-29 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC15764%27 HTTP/1.1" 200 None
2026-03-29 10:47:09 [auto1.de] INFO: Scrape type for BC15764: 2
2026-03-29 10:47:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 561e8718-84c7-588c-bf25-6bb9f51ff1c1 with identifier: BC15764
2026-03-29 10:47:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 561e8718-84c7-588c-bf25-6bb9f51ff1c1 with scrape type 2
2026-03-29 10:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 561e8718-84c7-588c-bf25-6bb9f51ff1c1 with scrape type 2
2026-03-29 10:47:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 561e8718-84c7-588c-bf25-6bb9f51ff1c1, identifier: BC15764
2026-03-29 10:47:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 984a1914-17a6-5a58-b562-c04073490779 with identifier: YU16554
2026-03-29 10:47:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 984a1914-17a6-5a58-b562-c04073490779 with identifier: YU16554
2026-03-29 10:47:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 984a1914-17a6-5a58-b562-c04073490779 with identifier: YU16554 to the API
2026-03-29 10:47:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:42:18Z',
 'fuel_type': 'diesel',
 'id': '984a1914-17a6-5a58-b562-c04073490779',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU16554',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 192828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-30',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2015}
2026-03-29 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU16554%27 HTTP/1.1" 200 None
2026-03-29 10:47:09 [auto1.de] INFO: Saving data for YU16554: {'auction_closing_time': 1774885338.0, 'created_time': 1773946998.261386, 'last_price_update_time': 1774781229.663361}
2026-03-29 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YU16554') HTTP/1.1" 204 0
2026-03-29 10:47:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 561e8718-84c7-588c-bf25-6bb9f51ff1c1 with identifier: BC15764
2026-03-29 10:47:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 561e8718-84c7-588c-bf25-6bb9f51ff1c1 with identifier: BC15764
2026-03-29 10:47:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 561e8718-84c7-588c-bf25-6bb9f51ff1c1 with identifier: BC15764 to the API
2026-03-29 10:47:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:48:15Z',
 'fuel_type': 'petrol',
 'id': '561e8718-84c7-588c-bf25-6bb9f51ff1c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC15764',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 105416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-10',
 'seller_name': None,
 'title': 'Ford C-Max 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2013}
2026-03-29 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC15764%27 HTTP/1.1" 200 None
2026-03-29 10:47:09 [auto1.de] INFO: Saving data for BC15764: {'auction_closing_time': 1774885695.0, 'created_time': 1774694206.331029, 'last_price_update_time': 1774781229.967221}
2026-03-29 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BC15764') HTTP/1.1" 204 0
2026-03-29 10:47:09 [auto1.de] INFO: Found listing with ID: PR78588
2026-03-29 10:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR78588%27 HTTP/1.1" 200 None
2026-03-29 10:47:10 [auto1.de] INFO: Scrape type for PR78588: 2
2026-03-29 10:47:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9531b28b-a3bb-5142-8b97-7531dea6b329 with identifier: PR78588
2026-03-29 10:47:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9531b28b-a3bb-5142-8b97-7531dea6b329 with scrape type 2
2026-03-29 10:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9531b28b-a3bb-5142-8b97-7531dea6b329 with scrape type 2
2026-03-29 10:47:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9531b28b-a3bb-5142-8b97-7531dea6b329, identifier: PR78588
2026-03-29 10:47:10 [auto1.de] INFO: Found listing with ID: YW82863
2026-03-29 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW82863%27 HTTP/1.1" 200 None
2026-03-29 10:47:10 [auto1.de] INFO: Scrape type for YW82863: 2
2026-03-29 10:47:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 773025ac-9114-5ff3-bce6-ad06fcf1366b with identifier: YW82863
2026-03-29 10:47:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 773025ac-9114-5ff3-bce6-ad06fcf1366b with scrape type 2
2026-03-29 10:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 773025ac-9114-5ff3-bce6-ad06fcf1366b with scrape type 2
2026-03-29 10:47:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 773025ac-9114-5ff3-bce6-ad06fcf1366b, identifier: YW82863
2026-03-29 10:47:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9531b28b-a3bb-5142-8b97-7531dea6b329 with identifier: PR78588
2026-03-29 10:47:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9531b28b-a3bb-5142-8b97-7531dea6b329 with identifier: PR78588
2026-03-29 10:47:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9531b28b-a3bb-5142-8b97-7531dea6b329 with identifier: PR78588 to the API
2026-03-29 10:47:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:58:41Z',
 'fuel_type': 'diesel',
 'id': '9531b28b-a3bb-5142-8b97-7531dea6b329',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR78588',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 225847,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-10',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 2.0 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2014}
2026-03-29 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR78588%27 HTTP/1.1" 200 None
2026-03-29 10:47:10 [auto1.de] INFO: Saving data for PR78588: {'auction_closing_time': 1774886321.0, 'created_time': 1774118964.206734, 'last_price_update_time': 1774781230.533344}
2026-03-29 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PR78588') HTTP/1.1" 204 0
2026-03-29 10:47:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 773025ac-9114-5ff3-bce6-ad06fcf1366b with identifier: YW82863
2026-03-29 10:47:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 773025ac-9114-5ff3-bce6-ad06fcf1366b with identifier: YW82863
2026-03-29 10:47:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 773025ac-9114-5ff3-bce6-ad06fcf1366b with identifier: YW82863 to the API
2026-03-29 10:47:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:13:59Z',
 'fuel_type': 'diesel',
 'id': '773025ac-9114-5ff3-bce6-ad06fcf1366b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW82863',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 182810,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-10',
 'seller_name': None,
 'title': 'Opel Crossland X 1.5 CDTI 120 Jahre',
 'transmission': 'automatic',
 'trim': '120 Jahre',
 'year': 2019}
2026-03-29 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW82863%27 HTTP/1.1" 200 None
2026-03-29 10:47:10 [auto1.de] INFO: Saving data for YW82863: {'auction_closing_time': 1774883639.0, 'created_time': 1774694209.615634, 'last_price_update_time': 1774781230.967665}
2026-03-29 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YW82863') HTTP/1.1" 204 0
2026-03-29 10:47:10 [auto1.de] INFO: Found listing with ID: RK30802
2026-03-29 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK30802%27 HTTP/1.1" 200 None
2026-03-29 10:47:10 [auto1.de] INFO: Scrape type for RK30802: 2
2026-03-29 10:47:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d0b94df-5fcb-5445-a6a4-09d44dd2fb5c with identifier: RK30802
2026-03-29 10:47:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d0b94df-5fcb-5445-a6a4-09d44dd2fb5c with scrape type 2
2026-03-29 10:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d0b94df-5fcb-5445-a6a4-09d44dd2fb5c with scrape type 2
2026-03-29 10:47:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d0b94df-5fcb-5445-a6a4-09d44dd2fb5c, identifier: RK30802
2026-03-29 10:47:11 [auto1.de] INFO: Found listing with ID: AR37862
2026-03-29 10:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR37862%27 HTTP/1.1" 200 None
2026-03-29 10:47:11 [auto1.de] INFO: Scrape type for AR37862: 2
2026-03-29 10:47:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be914301-f5ec-5d06-972c-f7e752f50444 with identifier: AR37862
2026-03-29 10:47:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be914301-f5ec-5d06-972c-f7e752f50444 with scrape type 2
2026-03-29 10:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be914301-f5ec-5d06-972c-f7e752f50444 with scrape type 2
2026-03-29 10:47:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be914301-f5ec-5d06-972c-f7e752f50444, identifier: AR37862
2026-03-29 10:47:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d0b94df-5fcb-5445-a6a4-09d44dd2fb5c with identifier: RK30802
2026-03-29 10:47:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d0b94df-5fcb-5445-a6a4-09d44dd2fb5c with identifier: RK30802
2026-03-29 10:47:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d0b94df-5fcb-5445-a6a4-09d44dd2fb5c with identifier: RK30802 to the API
2026-03-29 10:47:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:00:07Z',
 'fuel_type': 'petrol',
 'id': '3d0b94df-5fcb-5445-a6a4-09d44dd2fb5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK30802',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 190674,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-11',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2014}
2026-03-29 10:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK30802%27 HTTP/1.1" 200 None
2026-03-29 10:47:11 [auto1.de] INFO: Saving data for RK30802: {'auction_closing_time': 1774882807.0, 'created_time': 1774349927.690798, 'last_price_update_time': 1774781231.555689}
2026-03-29 10:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RK30802') HTTP/1.1" 204 0
2026-03-29 10:47:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be914301-f5ec-5d06-972c-f7e752f50444 with identifier: AR37862
2026-03-29 10:47:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be914301-f5ec-5d06-972c-f7e752f50444 with identifier: AR37862
2026-03-29 10:47:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be914301-f5ec-5d06-972c-f7e752f50444 with identifier: AR37862 to the API
2026-03-29 10:47:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:25:30Z',
 'fuel_type': 'diesel',
 'id': 'be914301-f5ec-5d06-972c-f7e752f50444',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR37862',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 269526,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-01-06',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2008}
2026-03-29 10:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR37862%27 HTTP/1.1" 200 None
2026-03-29 10:47:11 [auto1.de] INFO: Saving data for AR37862: {'auction_closing_time': 1774884330.0, 'created_time': 1774694394.995399, 'last_price_update_time': 1774781231.866035}
2026-03-29 10:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR37862') HTTP/1.1" 204 0
2026-03-29 10:47:11 [auto1.de] INFO: Found listing with ID: RW03523
2026-03-29 10:47:11 [auto1.de] INFO: Found listing with ID: ZY17523
2026-03-29 10:47:11 [auto1.de] INFO: Found listing with ID: GW53776
2026-03-29 10:47:11 [auto1.de] INFO: Found listing with ID: UB66562
2026-03-29 10:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB66562%27 HTTP/1.1" 200 None
2026-03-29 10:47:11 [auto1.de] INFO: Scrape type for UB66562: 2
2026-03-29 10:47:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed with identifier: UB66562
2026-03-29 10:47:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed with scrape type 2
2026-03-29 10:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed with scrape type 2
2026-03-29 10:47:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed, identifier: UB66562
2026-03-29 10:47:12 [auto1.de] INFO: Found listing with ID: XR83794
2026-03-29 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR83794%27 HTTP/1.1" 200 None
2026-03-29 10:47:12 [auto1.de] INFO: Scrape type for XR83794: 2
2026-03-29 10:47:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9f36d93-22b3-5f7b-bc96-916d6060ce90 with identifier: XR83794
2026-03-29 10:47:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9f36d93-22b3-5f7b-bc96-916d6060ce90 with scrape type 2
2026-03-29 10:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9f36d93-22b3-5f7b-bc96-916d6060ce90 with scrape type 2
2026-03-29 10:47:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d9f36d93-22b3-5f7b-bc96-916d6060ce90, identifier: XR83794
2026-03-29 10:47:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed with identifier: UB66562
2026-03-29 10:47:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed with identifier: UB66562
2026-03-29 10:47:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed with identifier: UB66562 to the API
2026-03-29 10:47:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:04:09Z',
 'fuel_type': 'diesel',
 'id': 'cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB66562',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 202966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-06',
 'seller_name': None,
 'title': 'Fiat Ducato 2.3 JTD 130',
 'transmission': 'manual',
 'trim': '130',
 'year': 2017}
2026-03-29 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB66562%27 HTTP/1.1" 200 None
2026-03-29 10:47:12 [auto1.de] INFO: Saving data for UB66562: {'auction_closing_time': 1774883049.0, 'created_time': 1774694343.367679, 'last_price_update_time': 1774781232.430102}
2026-03-29 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB66562') HTTP/1.1" 204 0
2026-03-29 10:47:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d9f36d93-22b3-5f7b-bc96-916d6060ce90 with identifier: XR83794
2026-03-29 10:47:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d9f36d93-22b3-5f7b-bc96-916d6060ce90 with identifier: XR83794
2026-03-29 10:47:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d9f36d93-22b3-5f7b-bc96-916d6060ce90 with identifier: XR83794 to the API
2026-03-29 10:47:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:34:50Z',
 'fuel_type': 'diesel',
 'id': 'd9f36d93-22b3-5f7b-bc96-916d6060ce90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR83794',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 233592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-22',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI T BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueTEC Avantgarde',
 'year': 2016}
2026-03-29 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR83794%27 HTTP/1.1" 200 None
2026-03-29 10:47:12 [auto1.de] INFO: Saving data for XR83794: {'auction_closing_time': 1774884890.0, 'created_time': 1773382492.08787, 'last_price_update_time': 1774781232.759235}
2026-03-29 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR83794') HTTP/1.1" 204 0
2026-03-29 10:47:12 [auto1.de] INFO: Found listing with ID: PH41345
2026-03-29 10:47:12 [auto1.de] INFO: Found listing with ID: FB79072
2026-03-29 10:47:12 [auto1.de] INFO: Found listing with ID: DY16606
2026-03-29 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY16606%27 HTTP/1.1" 200 None
2026-03-29 10:47:12 [auto1.de] INFO: Scrape type for DY16606: 2
2026-03-29 10:47:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e6bc9f2-b57f-5116-95a6-37e82f613bf1 with identifier: DY16606
2026-03-29 10:47:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e6bc9f2-b57f-5116-95a6-37e82f613bf1 with scrape type 2
2026-03-29 10:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e6bc9f2-b57f-5116-95a6-37e82f613bf1 with scrape type 2
2026-03-29 10:47:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e6bc9f2-b57f-5116-95a6-37e82f613bf1, identifier: DY16606
2026-03-29 10:47:12 [auto1.de] INFO: Found listing with ID: DM55805
2026-03-29 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM55805%27 HTTP/1.1" 200 None
2026-03-29 10:47:12 [auto1.de] INFO: Scrape type for DM55805: 2
2026-03-29 10:47:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a3f917b-5f2b-5942-8e54-3d38f01058ca with identifier: DM55805
2026-03-29 10:47:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a3f917b-5f2b-5942-8e54-3d38f01058ca with scrape type 2
2026-03-29 10:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a3f917b-5f2b-5942-8e54-3d38f01058ca with scrape type 2
2026-03-29 10:47:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a3f917b-5f2b-5942-8e54-3d38f01058ca, identifier: DM55805
2026-03-29 10:47:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e6bc9f2-b57f-5116-95a6-37e82f613bf1 with identifier: DY16606
2026-03-29 10:47:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e6bc9f2-b57f-5116-95a6-37e82f613bf1 with identifier: DY16606
2026-03-29 10:47:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e6bc9f2-b57f-5116-95a6-37e82f613bf1 with identifier: DY16606 to the API
2026-03-29 10:47:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:23:50Z',
 'fuel_type': 'petrol',
 'id': '5e6bc9f2-b57f-5116-95a6-37e82f613bf1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY16606',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 61153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-25',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2012}
2026-03-29 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY16606%27 HTTP/1.1" 200 None
2026-03-29 10:47:13 [auto1.de] INFO: Saving data for DY16606: {'auction_closing_time': 1774884230.0, 'created_time': 1774694193.535791, 'last_price_update_time': 1774781233.273686}
2026-03-29 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DY16606') HTTP/1.1" 204 0
2026-03-29 10:47:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a3f917b-5f2b-5942-8e54-3d38f01058ca with identifier: DM55805
2026-03-29 10:47:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a3f917b-5f2b-5942-8e54-3d38f01058ca with identifier: DM55805
2026-03-29 10:47:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a3f917b-5f2b-5942-8e54-3d38f01058ca with identifier: DM55805 to the API
2026-03-29 10:47:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:20:15Z',
 'fuel_type': 'petrol',
 'id': '5a3f917b-5f2b-5942-8e54-3d38f01058ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM55805',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 136090,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-30',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2012}
2026-03-29 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM55805%27 HTTP/1.1" 200 None
2026-03-29 10:47:13 [auto1.de] INFO: Saving data for DM55805: {'auction_closing_time': 1774884015.0, 'created_time': 1774694358.070033, 'last_price_update_time': 1774781233.645621}
2026-03-29 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM55805') HTTP/1.1" 204 0
2026-03-29 10:47:13 [auto1.de] INFO: Found listing with ID: DK90225
2026-03-29 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK90225%27 HTTP/1.1" 200 None
2026-03-29 10:47:13 [auto1.de] INFO: Scrape type for DK90225: 2
2026-03-29 10:47:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 124e09ec-1c44-5b2e-b9b8-a61131db057c with identifier: DK90225
2026-03-29 10:47:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 124e09ec-1c44-5b2e-b9b8-a61131db057c with scrape type 2
2026-03-29 10:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 124e09ec-1c44-5b2e-b9b8-a61131db057c with scrape type 2
2026-03-29 10:47:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 124e09ec-1c44-5b2e-b9b8-a61131db057c, identifier: DK90225
2026-03-29 10:47:13 [auto1.de] INFO: Found listing with ID: ZF87196
2026-03-29 10:47:13 [auto1.de] INFO: Found listing with ID: DK10749
2026-03-29 10:47:13 [auto1.de] INFO: Found listing with ID: DD00982
2026-03-29 10:47:13 [auto1.de] INFO: Found listing with ID: BR74031
2026-03-29 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR74031%27 HTTP/1.1" 200 None
2026-03-29 10:47:13 [auto1.de] INFO: Scrape type for BR74031: 2
2026-03-29 10:47:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3798b733-219f-5dc5-ab2f-2667d938148a with identifier: BR74031
2026-03-29 10:47:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3798b733-219f-5dc5-ab2f-2667d938148a with scrape type 2
2026-03-29 10:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3798b733-219f-5dc5-ab2f-2667d938148a with scrape type 2
2026-03-29 10:47:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3798b733-219f-5dc5-ab2f-2667d938148a, identifier: BR74031
2026-03-29 10:47:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 124e09ec-1c44-5b2e-b9b8-a61131db057c with identifier: DK90225
2026-03-29 10:47:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 124e09ec-1c44-5b2e-b9b8-a61131db057c with identifier: DK90225
2026-03-29 10:47:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 124e09ec-1c44-5b2e-b9b8-a61131db057c with identifier: DK90225 to the API
2026-03-29 10:47:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:19:49Z',
 'fuel_type': 'diesel',
 'id': '124e09ec-1c44-5b2e-b9b8-a61131db057c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK90225',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 261565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-23',
 'seller_name': None,
 'title': 'Hyundai ix35 2.0 CRDi Style AWD',
 'transmission': 'manual',
 'trim': 'Style AWD',
 'year': 2012}
2026-03-29 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK90225%27 HTTP/1.1" 200 None
2026-03-29 10:47:14 [auto1.de] INFO: Saving data for DK90225: {'auction_closing_time': 1774883989.0, 'created_time': 1774031875.673412, 'last_price_update_time': 1774781234.152154}
2026-03-29 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK90225') HTTP/1.1" 204 0
2026-03-29 10:47:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3798b733-219f-5dc5-ab2f-2667d938148a with identifier: BR74031
2026-03-29 10:47:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 10:47:14 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-29 10:47:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 10:47:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3798b733-219f-5dc5-ab2f-2667d938148a with identifier: BR74031
2026-03-29 10:47:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3798b733-219f-5dc5-ab2f-2667d938148a with identifier: BR74031 to the API
2026-03-29 10:47:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:55:02Z',
 'fuel_type': 'petrol',
 'id': '3798b733-219f-5dc5-ab2f-2667d938148a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR74031',
 'listing': 'auction',
 'make': 'Audi',
 'model': '80',
 'odometer': 188538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1987-12-09',
 'seller_name': None,
 'title': 'Audi 80 1.8',
 'transmission': 'manual',
 'trim': '',
 'year': 1987}
2026-03-29 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR74031%27 HTTP/1.1" 200 None
2026-03-29 10:47:14 [auto1.de] INFO: Saving data for BR74031: {'auction_closing_time': 1774886102.0, 'created_time': 1774118691.729781, 'last_price_update_time': 1774781234.546522}
2026-03-29 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR74031') HTTP/1.1" 204 0
2026-03-29 10:47:14 [auto1.de] INFO: Found listing with ID: MC13380
2026-03-29 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC13380%27 HTTP/1.1" 200 None
2026-03-29 10:47:14 [auto1.de] INFO: Scrape type for MC13380: 2
2026-03-29 10:47:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f744190-c74d-5c3b-9391-86d742611d60 with identifier: MC13380
2026-03-29 10:47:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f744190-c74d-5c3b-9391-86d742611d60 with scrape type 2
2026-03-29 10:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f744190-c74d-5c3b-9391-86d742611d60 with scrape type 2
2026-03-29 10:47:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f744190-c74d-5c3b-9391-86d742611d60, identifier: MC13380
2026-03-29 10:47:14 [auto1.de] INFO: Found listing with ID: JV93942
2026-03-29 10:47:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f744190-c74d-5c3b-9391-86d742611d60 with identifier: MC13380
2026-03-29 10:47:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f744190-c74d-5c3b-9391-86d742611d60 with identifier: MC13380
2026-03-29 10:47:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f744190-c74d-5c3b-9391-86d742611d60 with identifier: MC13380 to the API
2026-03-29 10:47:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:05:25Z',
 'fuel_type': 'petrol',
 'id': '0f744190-c74d-5c3b-9391-86d742611d60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC13380',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 73,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-30',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2020}
2026-03-29 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC13380%27 HTTP/1.1" 200 None
2026-03-29 10:47:14 [auto1.de] INFO: Saving data for MC13380: {'auction_closing_time': 1774883125.0, 'created_time': 1774032003.611331, 'last_price_update_time': 1774781234.954512}
2026-03-29 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MC13380') HTTP/1.1" 204 0
2026-03-29 10:47:14 [auto1.de] INFO: Found listing with ID: KW07987
2026-03-29 10:47:14 [auto1.de] INFO: Found listing with ID: HC06893
2026-03-29 10:47:14 [auto1.de] INFO: Found listing with ID: BM85402
2026-03-29 10:47:14 [auto1.de] INFO: Found listing with ID: CA67550
2026-03-29 10:47:14 [auto1.de] INFO: Found listing with ID: ZG02351
2026-03-29 10:47:14 [auto1.de] INFO: Found listing with ID: TD16668
2026-03-29 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD16668%27 HTTP/1.1" 200 None
2026-03-29 10:47:14 [auto1.de] INFO: Scrape type for TD16668: 2
2026-03-29 10:47:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d0020c2-0353-533d-adce-6bd1bb043478 with identifier: TD16668
2026-03-29 10:47:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d0020c2-0353-533d-adce-6bd1bb043478 with scrape type 2
2026-03-29 10:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d0020c2-0353-533d-adce-6bd1bb043478 with scrape type 2
2026-03-29 10:47:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d0020c2-0353-533d-adce-6bd1bb043478, identifier: TD16668
2026-03-29 10:47:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d0020c2-0353-533d-adce-6bd1bb043478 with identifier: TD16668
2026-03-29 10:47:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d0020c2-0353-533d-adce-6bd1bb043478 with identifier: TD16668
2026-03-29 10:47:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d0020c2-0353-533d-adce-6bd1bb043478 with identifier: TD16668 to the API
2026-03-29 10:47:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:33:24Z',
 'fuel_type': 'petrol',
 'id': '6d0020c2-0353-533d-adce-6bd1bb043478',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD16668',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 161194,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-09-09',
 'seller_name': None,
 'title': 'Audi TT 1.8 Turbo Roadster',
 'transmission': 'manual',
 'trim': 'Roadster',
 'year': 2003}
2026-03-29 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD16668%27 HTTP/1.1" 200 None
2026-03-29 10:47:15 [auto1.de] INFO: Saving data for TD16668: {'auction_closing_time': 1774884804.0, 'created_time': 1773427413.427599, 'last_price_update_time': 1774781235.363539}
2026-03-29 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TD16668') HTTP/1.1" 204 0
2026-03-29 10:47:15 [auto1.de] INFO: Found listing with ID: UK87241
2026-03-29 10:47:15 [auto1.de] INFO: Found listing with ID: GF54285
2026-03-29 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF54285%27 HTTP/1.1" 200 None
2026-03-29 10:47:15 [auto1.de] INFO: Scrape type for GF54285: 2
2026-03-29 10:47:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f338615-b78e-533c-a800-4bc3378e5914 with identifier: GF54285
2026-03-29 10:47:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f338615-b78e-533c-a800-4bc3378e5914 with scrape type 2
2026-03-29 10:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f338615-b78e-533c-a800-4bc3378e5914 with scrape type 2
2026-03-29 10:47:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f338615-b78e-533c-a800-4bc3378e5914, identifier: GF54285
2026-03-29 10:47:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f338615-b78e-533c-a800-4bc3378e5914 with identifier: GF54285
2026-03-29 10:47:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f338615-b78e-533c-a800-4bc3378e5914 with identifier: GF54285
2026-03-29 10:47:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f338615-b78e-533c-a800-4bc3378e5914 with identifier: GF54285 to the API
2026-03-29 10:47:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 295,
 'expiration_date': '2026-03-30T15:11:09Z',
 'fuel_type': 'petrol',
 'id': '9f338615-b78e-533c-a800-4bc3378e5914',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF54285',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayman',
 'odometer': 59722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-11-24',
 'seller_name': None,
 'title': 'Porsche Cayman S',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-03-29 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF54285%27 HTTP/1.1" 200 None
2026-03-29 10:47:15 [auto1.de] INFO: Saving data for GF54285: {'auction_closing_time': 1774883469.0, 'created_time': 1774694437.31208, 'last_price_update_time': 1774781235.871311}
2026-03-29 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF54285') HTTP/1.1" 204 0
2026-03-29 10:47:15 [auto1.de] INFO: Found listing with ID: JM74850
2026-03-29 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM74850%27 HTTP/1.1" 200 None
2026-03-29 10:47:15 [auto1.de] INFO: Scrape type for JM74850: 2
2026-03-29 10:47:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3eb70cd-2042-5bf9-90f8-52567c64b389 with identifier: JM74850
2026-03-29 10:47:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3eb70cd-2042-5bf9-90f8-52567c64b389 with scrape type 2
2026-03-29 10:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3eb70cd-2042-5bf9-90f8-52567c64b389 with scrape type 2
2026-03-29 10:47:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b3eb70cd-2042-5bf9-90f8-52567c64b389, identifier: JM74850
2026-03-29 10:47:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b3eb70cd-2042-5bf9-90f8-52567c64b389 with identifier: JM74850
2026-03-29 10:47:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b3eb70cd-2042-5bf9-90f8-52567c64b389 with identifier: JM74850
2026-03-29 10:47:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b3eb70cd-2042-5bf9-90f8-52567c64b389 with identifier: JM74850 to the API
2026-03-29 10:47:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:08:39Z',
 'fuel_type': 'diesel',
 'id': 'b3eb70cd-2042-5bf9-90f8-52567c64b389',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM74850',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 141603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-19',
 'seller_name': None,
 'title': 'Opel Meriva 1.7 CDTI Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2011}
2026-03-29 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM74850%27 HTTP/1.1" 200 None
2026-03-29 10:47:16 [auto1.de] INFO: Saving data for JM74850: {'auction_closing_time': 1774883319.0, 'created_time': 1774694436.370204, 'last_price_update_time': 1774781236.306767}
2026-03-29 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM74850') HTTP/1.1" 204 0
2026-03-29 10:47:16 [auto1.de] INFO: Found listing with ID: PJ27517
2026-03-29 10:47:16 [auto1.de] INFO: Found listing with ID: MN00804
2026-03-29 10:47:16 [auto1.de] INFO: Found listing with ID: CR42013
2026-03-29 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR42013%27 HTTP/1.1" 200 None
2026-03-29 10:47:16 [auto1.de] INFO: Scrape type for CR42013: 2
2026-03-29 10:47:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 803d7cd5-1181-5f39-a4cb-4550646e3bdb with identifier: CR42013
2026-03-29 10:47:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 803d7cd5-1181-5f39-a4cb-4550646e3bdb with scrape type 2
2026-03-29 10:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 803d7cd5-1181-5f39-a4cb-4550646e3bdb with scrape type 2
2026-03-29 10:47:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 803d7cd5-1181-5f39-a4cb-4550646e3bdb, identifier: CR42013
2026-03-29 10:47:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 803d7cd5-1181-5f39-a4cb-4550646e3bdb with identifier: CR42013
2026-03-29 10:47:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 803d7cd5-1181-5f39-a4cb-4550646e3bdb with identifier: CR42013
2026-03-29 10:47:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 803d7cd5-1181-5f39-a4cb-4550646e3bdb with identifier: CR42013 to the API
2026-03-29 10:47:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:24:51Z',
 'fuel_type': 'petrol',
 'id': '803d7cd5-1181-5f39-a4cb-4550646e3bdb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR42013',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 138881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-28',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI ACT Ambition ultra',
 'transmission': 'manual',
 'trim': 'Ambition ultra',
 'year': 2015}
2026-03-29 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR42013%27 HTTP/1.1" 200 None
2026-03-29 10:47:16 [auto1.de] INFO: Saving data for CR42013: {'auction_closing_time': 1774884291.0, 'created_time': 1774694197.253983, 'last_price_update_time': 1774781236.716373}
2026-03-29 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR42013') HTTP/1.1" 204 0
2026-03-29 10:47:16 [auto1.de] INFO: Found listing with ID: GH25955
2026-03-29 10:47:16 [auto1.de] INFO: Found listing with ID: AF81396
2026-03-29 10:47:16 [auto1.de] INFO: Found listing with ID: FJ89028
2026-03-29 10:47:16 [auto1.de] INFO: Found listing with ID: CU69011
2026-03-29 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU69011%27 HTTP/1.1" 200 None
2026-03-29 10:47:16 [auto1.de] INFO: Scrape type for CU69011: 2
2026-03-29 10:47:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd22ca28-403f-5268-aabe-0e6a40051b9a with identifier: CU69011
2026-03-29 10:47:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd22ca28-403f-5268-aabe-0e6a40051b9a with scrape type 2
2026-03-29 10:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd22ca28-403f-5268-aabe-0e6a40051b9a with scrape type 2
2026-03-29 10:47:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bd22ca28-403f-5268-aabe-0e6a40051b9a, identifier: CU69011
2026-03-29 10:47:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bd22ca28-403f-5268-aabe-0e6a40051b9a with identifier: CU69011
2026-03-29 10:47:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bd22ca28-403f-5268-aabe-0e6a40051b9a with identifier: CU69011
2026-03-29 10:47:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bd22ca28-403f-5268-aabe-0e6a40051b9a with identifier: CU69011 to the API
2026-03-29 10:47:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 290,
 'expiration_date': '2026-03-30T15:20:19Z',
 'fuel_type': 'petrol',
 'id': 'bd22ca28-403f-5268-aabe-0e6a40051b9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU69011',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 75347,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-04-22',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI TCR',
 'transmission': 'automatic',
 'trim': 'GTI TCR',
 'year': 2020}
2026-03-29 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU69011%27 HTTP/1.1" 200 None
2026-03-29 10:47:17 [auto1.de] INFO: Saving data for CU69011: {'auction_closing_time': 1774884019.0, 'created_time': 1774035193.015698, 'last_price_update_time': 1774781237.108978}
2026-03-29 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CU69011') HTTP/1.1" 204 0
2026-03-29 10:47:17 [auto1.de] INFO: Found listing with ID: GY71036
2026-03-29 10:47:17 [auto1.de] INFO: Found listing with ID: HB96226
2026-03-29 10:47:17 [auto1.de] INFO: Found listing with ID: GS36349
2026-03-29 10:47:17 [auto1.de] INFO: Found listing with ID: HA50795
2026-03-29 10:47:17 [auto1.de] INFO: Found listing with ID: UZ55149
2026-03-29 10:47:17 [auto1.de] INFO: Found listing with ID: NC03535
2026-03-29 10:47:17 [auto1.de] INFO: Found listing with ID: HR22131
2026-03-29 10:47:17 [auto1.de] INFO: Found listing with ID: YM01256
2026-03-29 10:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:47:17 [auto1.de] INFO: Channel: 24h | Page: 161 | totalHits: 6726 | hits on page: 40
2026-03-29 10:47:17 [auto1.de] INFO: Found listing with ID: WD92607
2026-03-29 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD92607%27 HTTP/1.1" 200 None
2026-03-29 10:47:17 [auto1.de] INFO: Scrape type for WD92607: 2
2026-03-29 10:47:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54737d39-fdf4-5dfd-86f5-23815799b0a9 with identifier: WD92607
2026-03-29 10:47:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54737d39-fdf4-5dfd-86f5-23815799b0a9 with scrape type 2
2026-03-29 10:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54737d39-fdf4-5dfd-86f5-23815799b0a9 with scrape type 2
2026-03-29 10:47:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54737d39-fdf4-5dfd-86f5-23815799b0a9, identifier: WD92607
2026-03-29 10:47:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54737d39-fdf4-5dfd-86f5-23815799b0a9 with identifier: WD92607
2026-03-29 10:47:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54737d39-fdf4-5dfd-86f5-23815799b0a9 with identifier: WD92607
2026-03-29 10:47:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54737d39-fdf4-5dfd-86f5-23815799b0a9 with identifier: WD92607 to the API
2026-03-29 10:47:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:27:59Z',
 'fuel_type': 'petrol',
 'id': '54737d39-fdf4-5dfd-86f5-23815799b0a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD92607',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 164426,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-04-10',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2006}
2026-03-29 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD92607%27 HTTP/1.1" 200 None
2026-03-29 10:47:17 [auto1.de] INFO: Saving data for WD92607: {'auction_closing_time': 1774884479.0, 'created_time': 1774694203.288782, 'last_price_update_time': 1774781237.78118}
2026-03-29 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WD92607') HTTP/1.1" 204 0
2026-03-29 10:47:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:47:17 [auto1.de] INFO: Found listing with ID: GM28208
2026-03-29 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM28208%27 HTTP/1.1" 200 None
2026-03-29 10:47:17 [auto1.de] INFO: Scrape type for GM28208: 2
2026-03-29 10:47:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b18d3337-9dac-5715-b7de-07abedf435ab with identifier: GM28208
2026-03-29 10:47:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b18d3337-9dac-5715-b7de-07abedf435ab with scrape type 2
2026-03-29 10:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b18d3337-9dac-5715-b7de-07abedf435ab with scrape type 2
2026-03-29 10:47:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b18d3337-9dac-5715-b7de-07abedf435ab, identifier: GM28208
2026-03-29 10:47:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b18d3337-9dac-5715-b7de-07abedf435ab with identifier: GM28208
2026-03-29 10:47:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b18d3337-9dac-5715-b7de-07abedf435ab with identifier: GM28208
2026-03-29 10:47:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b18d3337-9dac-5715-b7de-07abedf435ab with identifier: GM28208 to the API
2026-03-29 10:47:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:24:39Z',
 'fuel_type': 'petrol',
 'id': 'b18d3337-9dac-5715-b7de-07abedf435ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM28208',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Soul',
 'odometer': 244754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-17',
 'seller_name': None,
 'title': 'Kia Soul 1.6 Spirit',
 'transmission': 'manual',
 'trim': 'Spirit',
 'year': 2009}
2026-03-29 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM28208%27 HTTP/1.1" 200 None
2026-03-29 10:47:18 [auto1.de] INFO: Saving data for GM28208: {'auction_closing_time': 1774884279.0, 'created_time': 1774694195.641473, 'last_price_update_time': 1774781238.271208}
2026-03-29 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM28208') HTTP/1.1" 204 0
2026-03-29 10:47:18 [auto1.de] INFO: Found listing with ID: XE92374
2026-03-29 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE92374%27 HTTP/1.1" 200 None
2026-03-29 10:47:18 [auto1.de] INFO: Scrape type for XE92374: 2
2026-03-29 10:47:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8c23c2c-e67e-5a29-8050-c0aa11265903 with identifier: XE92374
2026-03-29 10:47:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8c23c2c-e67e-5a29-8050-c0aa11265903 with scrape type 2
2026-03-29 10:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8c23c2c-e67e-5a29-8050-c0aa11265903 with scrape type 2
2026-03-29 10:47:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c8c23c2c-e67e-5a29-8050-c0aa11265903, identifier: XE92374
2026-03-29 10:47:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c8c23c2c-e67e-5a29-8050-c0aa11265903 with identifier: XE92374
2026-03-29 10:47:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c8c23c2c-e67e-5a29-8050-c0aa11265903 with identifier: XE92374
2026-03-29 10:47:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c8c23c2c-e67e-5a29-8050-c0aa11265903 with identifier: XE92374 to the API
2026-03-29 10:47:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:29:26Z',
 'fuel_type': 'petrol',
 'id': 'c8c23c2c-e67e-5a29-8050-c0aa11265903',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE92374',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 96383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-08-24',
 'seller_name': None,
 'title': 'MINI Cabrio Cooper',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-29 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE92374%27 HTTP/1.1" 200 None
2026-03-29 10:47:18 [auto1.de] INFO: Saving data for XE92374: {'auction_closing_time': 1774884566.0, 'created_time': 1774694338.560635, 'last_price_update_time': 1774781238.67479}
2026-03-29 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE92374') HTTP/1.1" 204 0
2026-03-29 10:47:18 [auto1.de] INFO: Found listing with ID: EZ06190
2026-03-29 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ06190%27 HTTP/1.1" 200 None
2026-03-29 10:47:18 [auto1.de] INFO: Scrape type for EZ06190: 2
2026-03-29 10:47:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15c44ef8-64b7-58f1-aa0f-aa69c71c22d2 with identifier: EZ06190
2026-03-29 10:47:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15c44ef8-64b7-58f1-aa0f-aa69c71c22d2 with scrape type 2
2026-03-29 10:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15c44ef8-64b7-58f1-aa0f-aa69c71c22d2 with scrape type 2
2026-03-29 10:47:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15c44ef8-64b7-58f1-aa0f-aa69c71c22d2, identifier: EZ06190
2026-03-29 10:47:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15c44ef8-64b7-58f1-aa0f-aa69c71c22d2 with identifier: EZ06190
2026-03-29 10:47:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15c44ef8-64b7-58f1-aa0f-aa69c71c22d2 with identifier: EZ06190
2026-03-29 10:47:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15c44ef8-64b7-58f1-aa0f-aa69c71c22d2 with identifier: EZ06190 to the API
2026-03-29 10:47:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:27:56Z',
 'fuel_type': 'diesel',
 'id': '15c44ef8-64b7-58f1-aa0f-aa69c71c22d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ06190',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 171828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-04-13',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2003}
2026-03-29 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ06190%27 HTTP/1.1" 200 None
2026-03-29 10:47:19 [auto1.de] INFO: Saving data for EZ06190: {'auction_closing_time': 1774884476.0, 'created_time': 1774694196.872689, 'last_price_update_time': 1774781239.05796}
2026-03-29 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ06190') HTTP/1.1" 204 0
2026-03-29 10:47:19 [auto1.de] INFO: Found listing with ID: AD09354
2026-03-29 10:47:19 [auto1.de] INFO: Found listing with ID: RE79871
2026-03-29 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE79871%27 HTTP/1.1" 200 None
2026-03-29 10:47:19 [auto1.de] INFO: Scrape type for RE79871: 2
2026-03-29 10:47:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d742c00-bce8-52f3-be15-56c84b379a5f with identifier: RE79871
2026-03-29 10:47:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d742c00-bce8-52f3-be15-56c84b379a5f with scrape type 2
2026-03-29 10:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d742c00-bce8-52f3-be15-56c84b379a5f with scrape type 2
2026-03-29 10:47:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d742c00-bce8-52f3-be15-56c84b379a5f, identifier: RE79871
2026-03-29 10:47:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d742c00-bce8-52f3-be15-56c84b379a5f with identifier: RE79871
2026-03-29 10:47:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d742c00-bce8-52f3-be15-56c84b379a5f with identifier: RE79871
2026-03-29 10:47:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d742c00-bce8-52f3-be15-56c84b379a5f with identifier: RE79871 to the API
2026-03-29 10:47:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:09:55Z',
 'fuel_type': 'petrol',
 'id': '4d742c00-bce8-52f3-be15-56c84b379a5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE79871',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 115917,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-15',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost SYNC Edition',
 'transmission': 'manual',
 'trim': 'SYNC Edition',
 'year': 2014}
2026-03-29 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE79871%27 HTTP/1.1" 200 None
2026-03-29 10:47:19 [auto1.de] INFO: Saving data for RE79871: {'auction_closing_time': 1774883395.0, 'created_time': 1774694190.366859, 'last_price_update_time': 1774781239.448439}
2026-03-29 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE79871') HTTP/1.1" 204 0
2026-03-29 10:47:19 [auto1.de] INFO: Found listing with ID: YD36788
2026-03-29 10:47:19 [auto1.de] INFO: Found listing with ID: EY64053
2026-03-29 10:47:19 [auto1.de] INFO: Found listing with ID: NK14391
2026-03-29 10:47:19 [auto1.de] INFO: Found listing with ID: HA88960
2026-03-29 10:47:19 [auto1.de] INFO: Found listing with ID: CV20886
2026-03-29 10:47:19 [auto1.de] INFO: Found listing with ID: BF20079
2026-03-29 10:47:19 [auto1.de] INFO: Found listing with ID: GJ71513
2026-03-29 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ71513%27 HTTP/1.1" 200 None
2026-03-29 10:47:19 [auto1.de] INFO: Scrape type for GJ71513: 2
2026-03-29 10:47:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcc87069-f6a2-5836-8bb9-53c3df7f289b with identifier: GJ71513
2026-03-29 10:47:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcc87069-f6a2-5836-8bb9-53c3df7f289b with scrape type 2
2026-03-29 10:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcc87069-f6a2-5836-8bb9-53c3df7f289b with scrape type 2
2026-03-29 10:47:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fcc87069-f6a2-5836-8bb9-53c3df7f289b, identifier: GJ71513
2026-03-29 10:47:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fcc87069-f6a2-5836-8bb9-53c3df7f289b with identifier: GJ71513
2026-03-29 10:47:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fcc87069-f6a2-5836-8bb9-53c3df7f289b with identifier: GJ71513
2026-03-29 10:47:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fcc87069-f6a2-5836-8bb9-53c3df7f289b with identifier: GJ71513 to the API
2026-03-29 10:47:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:16:02Z',
 'fuel_type': 'diesel',
 'id': 'fcc87069-f6a2-5836-8bb9-53c3df7f289b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ71513',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 169877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-26',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2013}
2026-03-29 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ71513%27 HTTP/1.1" 200 None
2026-03-29 10:47:19 [auto1.de] INFO: Saving data for GJ71513: {'auction_closing_time': 1774883762.0, 'created_time': 1774694236.473767, 'last_price_update_time': 1774781239.831321}
2026-03-29 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ71513') HTTP/1.1" 204 0
2026-03-29 10:47:19 [auto1.de] INFO: Found listing with ID: XT67531
2026-03-29 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT67531%27 HTTP/1.1" 200 None
2026-03-29 10:47:19 [auto1.de] INFO: Scrape type for XT67531: 2
2026-03-29 10:47:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61c1af49-815a-504c-a558-02cf66456752 with identifier: XT67531
2026-03-29 10:47:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61c1af49-815a-504c-a558-02cf66456752 with scrape type 2
2026-03-29 10:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61c1af49-815a-504c-a558-02cf66456752 with scrape type 2
2026-03-29 10:47:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61c1af49-815a-504c-a558-02cf66456752, identifier: XT67531
2026-03-29 10:47:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61c1af49-815a-504c-a558-02cf66456752 with identifier: XT67531
2026-03-29 10:47:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61c1af49-815a-504c-a558-02cf66456752 with identifier: XT67531
2026-03-29 10:47:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61c1af49-815a-504c-a558-02cf66456752 with identifier: XT67531 to the API
2026-03-29 10:47:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:45:40Z',
 'fuel_type': 'diesel',
 'id': '61c1af49-815a-504c-a558-02cf66456752',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT67531',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 25866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-11',
 'seller_name': None,
 'title': 'Audi A4 40 TDI Mild-Hybrid S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2022}
2026-03-29 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT67531%27 HTTP/1.1" 200 None
2026-03-29 10:47:20 [auto1.de] INFO: Saving data for XT67531: {'auction_closing_time': 1774885540.0, 'created_time': 1773400883.719555, 'last_price_update_time': 1774781240.334388}
2026-03-29 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT67531') HTTP/1.1" 204 0
2026-03-29 10:47:20 [auto1.de] INFO: Found listing with ID: PB33753
2026-03-29 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB33753%27 HTTP/1.1" 200 None
2026-03-29 10:47:20 [auto1.de] INFO: Scrape type for PB33753: 2
2026-03-29 10:47:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4097f511-da79-5ae6-8838-5c787425998b with identifier: PB33753
2026-03-29 10:47:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4097f511-da79-5ae6-8838-5c787425998b with scrape type 2
2026-03-29 10:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4097f511-da79-5ae6-8838-5c787425998b with scrape type 2
2026-03-29 10:47:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4097f511-da79-5ae6-8838-5c787425998b, identifier: PB33753
2026-03-29 10:47:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4097f511-da79-5ae6-8838-5c787425998b with identifier: PB33753
2026-03-29 10:47:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4097f511-da79-5ae6-8838-5c787425998b with identifier: PB33753
2026-03-29 10:47:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4097f511-da79-5ae6-8838-5c787425998b with identifier: PB33753 to the API
2026-03-29 10:47:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 449,
 'expiration_date': '2026-03-30T15:50:30Z',
 'fuel_type': 'hybrid',
 'id': '4097f511-da79-5ae6-8838-5c787425998b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB33753',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A8',
 'odometer': 99949,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-23',
 'seller_name': None,
 'title': 'Audi A8 60 TFSIe quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2021}
2026-03-29 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB33753%27 HTTP/1.1" 200 None
2026-03-29 10:47:20 [auto1.de] INFO: Saving data for PB33753: {'auction_closing_time': 1774885830.0, 'created_time': 1774157730.125484, 'last_price_update_time': 1774781240.741023}
2026-03-29 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB33753') HTTP/1.1" 204 0
2026-03-29 10:47:20 [auto1.de] INFO: Found listing with ID: TU57767
2026-03-29 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU57767%27 HTTP/1.1" 200 None
2026-03-29 10:47:20 [auto1.de] INFO: Scrape type for TU57767: 2
2026-03-29 10:47:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bb187f1-529f-5012-a4d4-fe1c6e24e1df with identifier: TU57767
2026-03-29 10:47:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bb187f1-529f-5012-a4d4-fe1c6e24e1df with scrape type 2
2026-03-29 10:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1bb187f1-529f-5012-a4d4-fe1c6e24e1df with scrape type 2
2026-03-29 10:47:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1bb187f1-529f-5012-a4d4-fe1c6e24e1df, identifier: TU57767
2026-03-29 10:47:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1bb187f1-529f-5012-a4d4-fe1c6e24e1df with identifier: TU57767
2026-03-29 10:47:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1bb187f1-529f-5012-a4d4-fe1c6e24e1df with identifier: TU57767
2026-03-29 10:47:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1bb187f1-529f-5012-a4d4-fe1c6e24e1df with identifier: TU57767 to the API
2026-03-29 10:47:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:45:46Z',
 'fuel_type': 'petrol',
 'id': '1bb187f1-529f-5012-a4d4-fe1c6e24e1df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU57767',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 54108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-07',
 'seller_name': None,
 'title': 'MINI One Essential Trim',
 'transmission': 'automatic',
 'trim': 'Essential Trim',
 'year': 2022}
2026-03-29 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU57767%27 HTTP/1.1" 200 None
2026-03-29 10:47:21 [auto1.de] INFO: Saving data for TU57767: {'auction_closing_time': 1774885546.0, 'created_time': 1774034539.307449, 'last_price_update_time': 1774781241.159943}
2026-03-29 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU57767') HTTP/1.1" 204 0
2026-03-29 10:47:21 [auto1.de] INFO: Found listing with ID: YH86831
2026-03-29 10:47:21 [auto1.de] INFO: Found listing with ID: GU24004
2026-03-29 10:47:21 [auto1.de] INFO: Found listing with ID: KR12848
2026-03-29 10:47:21 [auto1.de] INFO: Found listing with ID: HR78495
2026-03-29 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR78495%27 HTTP/1.1" 200 None
2026-03-29 10:47:21 [auto1.de] INFO: Scrape type for HR78495: 2
2026-03-29 10:47:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d4587a8-cf35-5bc1-88a2-55a4d6348a0a with identifier: HR78495
2026-03-29 10:47:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d4587a8-cf35-5bc1-88a2-55a4d6348a0a with scrape type 2
2026-03-29 10:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d4587a8-cf35-5bc1-88a2-55a4d6348a0a with scrape type 2
2026-03-29 10:47:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d4587a8-cf35-5bc1-88a2-55a4d6348a0a, identifier: HR78495
2026-03-29 10:47:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d4587a8-cf35-5bc1-88a2-55a4d6348a0a with identifier: HR78495
2026-03-29 10:47:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d4587a8-cf35-5bc1-88a2-55a4d6348a0a with identifier: HR78495
2026-03-29 10:47:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d4587a8-cf35-5bc1-88a2-55a4d6348a0a with identifier: HR78495 to the API
2026-03-29 10:47:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:45:48Z',
 'fuel_type': 'petrol',
 'id': '1d4587a8-cf35-5bc1-88a2-55a4d6348a0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR78495',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 244554,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-30',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2009}
2026-03-29 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR78495%27 HTTP/1.1" 200 None
2026-03-29 10:47:21 [auto1.de] INFO: Saving data for HR78495: {'auction_closing_time': 1774885548.0, 'created_time': 1774694231.535546, 'last_price_update_time': 1774781241.57191}
2026-03-29 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR78495') HTTP/1.1" 204 0
2026-03-29 10:47:21 [auto1.de] INFO: Found listing with ID: RR83304
2026-03-29 10:47:21 [auto1.de] INFO: Found listing with ID: UE39516
2026-03-29 10:47:21 [auto1.de] INFO: Found listing with ID: GM93366
2026-03-29 10:47:21 [auto1.de] INFO: Found listing with ID: VV13794
2026-03-29 10:47:21 [auto1.de] INFO: Found listing with ID: RU85035
2026-03-29 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU85035%27 HTTP/1.1" 200 None
2026-03-29 10:47:21 [auto1.de] INFO: Scrape type for RU85035: 2
2026-03-29 10:47:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4b5d4e7-2221-54c7-b92b-845280338fb5 with identifier: RU85035
2026-03-29 10:47:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4b5d4e7-2221-54c7-b92b-845280338fb5 with scrape type 2
2026-03-29 10:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4b5d4e7-2221-54c7-b92b-845280338fb5 with scrape type 2
2026-03-29 10:47:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d4b5d4e7-2221-54c7-b92b-845280338fb5, identifier: RU85035
2026-03-29 10:47:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d4b5d4e7-2221-54c7-b92b-845280338fb5 with identifier: RU85035
2026-03-29 10:47:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d4b5d4e7-2221-54c7-b92b-845280338fb5 with identifier: RU85035
2026-03-29 10:47:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d4b5d4e7-2221-54c7-b92b-845280338fb5 with identifier: RU85035 to the API
2026-03-29 10:47:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:56:28Z',
 'fuel_type': 'petrol',
 'id': 'd4b5d4e7-2221-54c7-b92b-845280338fb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU85035',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 146737,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-30',
 'seller_name': None,
 'title': 'Renault Megane 1.4 TCe Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2012}
2026-03-29 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU85035%27 HTTP/1.1" 200 None
2026-03-29 10:47:21 [auto1.de] INFO: Saving data for RU85035: {'auction_closing_time': 1774886188.0, 'created_time': 1774694357.354765, 'last_price_update_time': 1774781241.970079}
2026-03-29 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU85035') HTTP/1.1" 204 0
2026-03-29 10:47:22 [auto1.de] INFO: Found listing with ID: YZ93314
2026-03-29 10:47:22 [auto1.de] INFO: Found listing with ID: VJ45584
2026-03-29 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ45584%27 HTTP/1.1" 200 None
2026-03-29 10:47:22 [auto1.de] INFO: Scrape type for VJ45584: 2
2026-03-29 10:47:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34e114cc-68be-5e54-af11-1d5fd7bb5bc3 with identifier: VJ45584
2026-03-29 10:47:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34e114cc-68be-5e54-af11-1d5fd7bb5bc3 with scrape type 2
2026-03-29 10:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34e114cc-68be-5e54-af11-1d5fd7bb5bc3 with scrape type 2
2026-03-29 10:47:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34e114cc-68be-5e54-af11-1d5fd7bb5bc3, identifier: VJ45584
2026-03-29 10:47:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34e114cc-68be-5e54-af11-1d5fd7bb5bc3 with identifier: VJ45584
2026-03-29 10:47:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34e114cc-68be-5e54-af11-1d5fd7bb5bc3 with identifier: VJ45584
2026-03-29 10:47:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34e114cc-68be-5e54-af11-1d5fd7bb5bc3 with identifier: VJ45584 to the API
2026-03-29 10:47:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:38:35Z',
 'fuel_type': 'petrol',
 'id': '34e114cc-68be-5e54-af11-1d5fd7bb5bc3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ45584',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 137753,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-09',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2016}
2026-03-29 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ45584%27 HTTP/1.1" 200 None
2026-03-29 10:47:22 [auto1.de] INFO: Saving data for VJ45584: {'auction_closing_time': 1774885115.0, 'created_time': 1774694304.98772, 'last_price_update_time': 1774781242.449966}
2026-03-29 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ45584') HTTP/1.1" 204 0
2026-03-29 10:47:22 [auto1.de] INFO: Found listing with ID: ZE64138
2026-03-29 10:47:22 [auto1.de] INFO: Found listing with ID: FH72870
2026-03-29 10:47:22 [auto1.de] INFO: Found listing with ID: RV36249
2026-03-29 10:47:22 [auto1.de] INFO: Found listing with ID: GR32471
2026-03-29 10:47:22 [auto1.de] INFO: Found listing with ID: UB45344
2026-03-29 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB45344%27 HTTP/1.1" 200 None
2026-03-29 10:47:22 [auto1.de] INFO: Scrape type for UB45344: 2
2026-03-29 10:47:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a9796d0-696a-55e5-92f4-c02db7e684e3 with identifier: UB45344
2026-03-29 10:47:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a9796d0-696a-55e5-92f4-c02db7e684e3 with scrape type 2
2026-03-29 10:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a9796d0-696a-55e5-92f4-c02db7e684e3 with scrape type 2
2026-03-29 10:47:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a9796d0-696a-55e5-92f4-c02db7e684e3, identifier: UB45344
2026-03-29 10:47:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a9796d0-696a-55e5-92f4-c02db7e684e3 with identifier: UB45344
2026-03-29 10:47:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a9796d0-696a-55e5-92f4-c02db7e684e3 with identifier: UB45344
2026-03-29 10:47:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a9796d0-696a-55e5-92f4-c02db7e684e3 with identifier: UB45344 to the API
2026-03-29 10:47:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:39:54Z',
 'fuel_type': 'petrol',
 'id': '2a9796d0-696a-55e5-92f4-c02db7e684e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB45344',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 205575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-04',
 'seller_name': None,
 'title': 'Ford Focus 1.6 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2013}
2026-03-29 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB45344%27 HTTP/1.1" 200 None
2026-03-29 10:47:22 [auto1.de] INFO: Saving data for UB45344: {'auction_closing_time': 1774885194.0, 'created_time': 1774694306.941891, 'last_price_update_time': 1774781242.850843}
2026-03-29 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB45344') HTTP/1.1" 204 0
2026-03-29 10:47:22 [auto1.de] INFO: Found listing with ID: TJ69669
2026-03-29 10:47:22 [auto1.de] INFO: Found listing with ID: CX33153
2026-03-29 10:47:22 [auto1.de] INFO: Found listing with ID: XL82798
2026-03-29 10:47:22 [auto1.de] INFO: Found listing with ID: NF65282
2026-03-29 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF65282%27 HTTP/1.1" 200 None
2026-03-29 10:47:22 [auto1.de] INFO: Scrape type for NF65282: 2
2026-03-29 10:47:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8b74cfa-2c76-5a7c-8e97-787bfee53098 with identifier: NF65282
2026-03-29 10:47:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8b74cfa-2c76-5a7c-8e97-787bfee53098 with scrape type 2
2026-03-29 10:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8b74cfa-2c76-5a7c-8e97-787bfee53098 with scrape type 2
2026-03-29 10:47:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8b74cfa-2c76-5a7c-8e97-787bfee53098, identifier: NF65282
2026-03-29 10:47:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8b74cfa-2c76-5a7c-8e97-787bfee53098 with identifier: NF65282
2026-03-29 10:47:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8b74cfa-2c76-5a7c-8e97-787bfee53098 with identifier: NF65282
2026-03-29 10:47:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8b74cfa-2c76-5a7c-8e97-787bfee53098 with identifier: NF65282 to the API
2026-03-29 10:47:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:23:46Z',
 'fuel_type': 'petrol',
 'id': 'e8b74cfa-2c76-5a7c-8e97-787bfee53098',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF65282',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 120688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-26',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TSI RS 245',
 'transmission': 'automatic',
 'trim': 'RS 245',
 'year': 2020}
2026-03-29 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF65282%27 HTTP/1.1" 200 None
2026-03-29 10:47:23 [auto1.de] INFO: Saving data for NF65282: {'auction_closing_time': 1774884226.0, 'created_time': 1774350218.094065, 'last_price_update_time': 1774781243.336579}
2026-03-29 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF65282') HTTP/1.1" 204 0
2026-03-29 10:47:23 [auto1.de] INFO: Found listing with ID: DE88009
2026-03-29 10:47:23 [auto1.de] INFO: Found listing with ID: HF51839
2026-03-29 10:47:23 [auto1.de] INFO: Found listing with ID: LM10522
2026-03-29 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM10522%27 HTTP/1.1" 200 None
2026-03-29 10:47:23 [auto1.de] INFO: Scrape type for LM10522: 2
2026-03-29 10:47:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3 with identifier: LM10522
2026-03-29 10:47:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3 with scrape type 2
2026-03-29 10:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3 with scrape type 2
2026-03-29 10:47:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3, identifier: LM10522
2026-03-29 10:47:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3 with identifier: LM10522
2026-03-29 10:47:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3 with identifier: LM10522
2026-03-29 10:47:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3 with identifier: LM10522 to the API
2026-03-29 10:47:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:17:13Z',
 'fuel_type': 'diesel',
 'id': 'ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM10522',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 274926,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-17',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2011}
2026-03-29 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM10522%27 HTTP/1.1" 200 None
2026-03-29 10:47:23 [auto1.de] INFO: Saving data for LM10522: {'auction_closing_time': 1774883833.0, 'created_time': 1774694455.470477, 'last_price_update_time': 1774781243.820967}
2026-03-29 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM10522') HTTP/1.1" 204 0
2026-03-29 10:47:23 [auto1.de] INFO: Found listing with ID: VG29831
2026-03-29 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG29831%27 HTTP/1.1" 200 None
2026-03-29 10:47:23 [auto1.de] INFO: Scrape type for VG29831: 2
2026-03-29 10:47:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6c7c0a9-8c10-5695-be4f-4099aeac8b34 with identifier: VG29831
2026-03-29 10:47:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6c7c0a9-8c10-5695-be4f-4099aeac8b34 with scrape type 2
2026-03-29 10:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6c7c0a9-8c10-5695-be4f-4099aeac8b34 with scrape type 2
2026-03-29 10:47:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6c7c0a9-8c10-5695-be4f-4099aeac8b34, identifier: VG29831
2026-03-29 10:47:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6c7c0a9-8c10-5695-be4f-4099aeac8b34 with identifier: VG29831
2026-03-29 10:47:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6c7c0a9-8c10-5695-be4f-4099aeac8b34 with identifier: VG29831
2026-03-29 10:47:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6c7c0a9-8c10-5695-be4f-4099aeac8b34 with identifier: VG29831 to the API
2026-03-29 10:47:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:17:42Z',
 'fuel_type': 'petrol',
 'id': 'e6c7c0a9-8c10-5695-be4f-4099aeac8b34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG29831',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 87251,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-24',
 'seller_name': None,
 'title': 'Hyundai i20 1.2 YES!',
 'transmission': 'manual',
 'trim': 'YES!',
 'year': 2015}
2026-03-29 10:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG29831%27 HTTP/1.1" 200 None
2026-03-29 10:47:24 [auto1.de] INFO: Saving data for VG29831: {'auction_closing_time': 1774883862.0, 'created_time': 1774694275.877066, 'last_price_update_time': 1774781244.233616}
2026-03-29 10:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG29831') HTTP/1.1" 204 0
2026-03-29 10:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:47:51 [auto1.de] INFO: Channel: 24h | Page: 162 | totalHits: 6726 | hits on page: 40
2026-03-29 10:47:51 [auto1.de] INFO: Found listing with ID: GX51381
2026-03-29 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX51381%27 HTTP/1.1" 200 None
2026-03-29 10:47:51 [auto1.de] INFO: Scrape type for GX51381: 2
2026-03-29 10:47:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71515936-d968-56b2-a834-e33fb484c195 with identifier: GX51381
2026-03-29 10:47:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71515936-d968-56b2-a834-e33fb484c195 with scrape type 2
2026-03-29 10:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71515936-d968-56b2-a834-e33fb484c195 with scrape type 2
2026-03-29 10:47:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71515936-d968-56b2-a834-e33fb484c195, identifier: GX51381
2026-03-29 10:47:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71515936-d968-56b2-a834-e33fb484c195 with identifier: GX51381
2026-03-29 10:47:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71515936-d968-56b2-a834-e33fb484c195 with identifier: GX51381
2026-03-29 10:47:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71515936-d968-56b2-a834-e33fb484c195 with identifier: GX51381 to the API
2026-03-29 10:47:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:08:56Z',
 'fuel_type': 'petrol',
 'id': '71515936-d968-56b2-a834-e33fb484c195',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX51381',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 55455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-06',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TSI Sportline 4x4',
 'transmission': 'automatic',
 'trim': 'Sportline 4x4',
 'year': 2021}
2026-03-29 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX51381%27 HTTP/1.1" 200 None
2026-03-29 10:47:52 [auto1.de] INFO: Saving data for GX51381: {'auction_closing_time': 1774883336.0, 'created_time': 1774694273.6877, 'last_price_update_time': 1774781272.010997}
2026-03-29 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX51381') HTTP/1.1" 204 0
2026-03-29 10:47:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:47:52 [auto1.de] INFO: Found listing with ID: EC79074
2026-03-29 10:47:52 [auto1.de] INFO: Found listing with ID: YP50016
2026-03-29 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP50016%27 HTTP/1.1" 200 None
2026-03-29 10:47:52 [auto1.de] INFO: Scrape type for YP50016: 2
2026-03-29 10:47:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4b44cf2-9a77-5e81-af0a-0b5ff1dfdc99 with identifier: YP50016
2026-03-29 10:47:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4b44cf2-9a77-5e81-af0a-0b5ff1dfdc99 with scrape type 2
2026-03-29 10:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4b44cf2-9a77-5e81-af0a-0b5ff1dfdc99 with scrape type 2
2026-03-29 10:47:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4b44cf2-9a77-5e81-af0a-0b5ff1dfdc99, identifier: YP50016
2026-03-29 10:47:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4b44cf2-9a77-5e81-af0a-0b5ff1dfdc99 with identifier: YP50016
2026-03-29 10:47:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4b44cf2-9a77-5e81-af0a-0b5ff1dfdc99 with identifier: YP50016
2026-03-29 10:47:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4b44cf2-9a77-5e81-af0a-0b5ff1dfdc99 with identifier: YP50016 to the API
2026-03-29 10:47:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:09:20Z',
 'fuel_type': 'diesel',
 'id': 'a4b44cf2-9a77-5e81-af0a-0b5ff1dfdc99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP50016',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 212946,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-22',
 'seller_name': None,
 'title': 'Honda Civic 1.6 DTEC Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2014}
2026-03-29 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP50016%27 HTTP/1.1" 200 None
2026-03-29 10:47:52 [auto1.de] INFO: Saving data for YP50016: {'auction_closing_time': 1774883360.0, 'created_time': 1774034636.245534, 'last_price_update_time': 1774781272.46202}
2026-03-29 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YP50016') HTTP/1.1" 204 0
2026-03-29 10:47:52 [auto1.de] INFO: Found listing with ID: KE20907
2026-03-29 10:47:52 [auto1.de] INFO: Found listing with ID: XN06908
2026-03-29 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN06908%27 HTTP/1.1" 200 None
2026-03-29 10:47:52 [auto1.de] INFO: Scrape type for XN06908: 2
2026-03-29 10:47:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d01d59a-ee3b-566a-8040-a9a8ecc225e8 with identifier: XN06908
2026-03-29 10:47:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d01d59a-ee3b-566a-8040-a9a8ecc225e8 with scrape type 2
2026-03-29 10:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d01d59a-ee3b-566a-8040-a9a8ecc225e8 with scrape type 2
2026-03-29 10:47:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d01d59a-ee3b-566a-8040-a9a8ecc225e8, identifier: XN06908
2026-03-29 10:47:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d01d59a-ee3b-566a-8040-a9a8ecc225e8 with identifier: XN06908
2026-03-29 10:47:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d01d59a-ee3b-566a-8040-a9a8ecc225e8 with identifier: XN06908
2026-03-29 10:47:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d01d59a-ee3b-566a-8040-a9a8ecc225e8 with identifier: XN06908 to the API
2026-03-29 10:47:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 121,
 'expiration_date': '2026-03-30T15:52:23Z',
 'fuel_type': 'petrol',
 'id': '6d01d59a-ee3b-566a-8040-a9a8ecc225e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN06908',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 127929,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-25',
 'seller_name': None,
 'title': 'Mazda CX-3 2.0 Skyactiv-G Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2019}
2026-03-29 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN06908%27 HTTP/1.1" 200 None
2026-03-29 10:47:52 [auto1.de] INFO: Saving data for XN06908: {'auction_closing_time': 1774885943.0, 'created_time': 1774694359.75549, 'last_price_update_time': 1774781272.863722}
2026-03-29 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XN06908') HTTP/1.1" 204 0
2026-03-29 10:47:52 [auto1.de] INFO: Found listing with ID: SY64199
2026-03-29 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY64199%27 HTTP/1.1" 200 None
2026-03-29 10:47:52 [auto1.de] INFO: Scrape type for SY64199: 2
2026-03-29 10:47:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fc5a3a0-9801-53af-970f-10ff26ba3835 with identifier: SY64199
2026-03-29 10:47:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fc5a3a0-9801-53af-970f-10ff26ba3835 with scrape type 2
2026-03-29 10:47:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fc5a3a0-9801-53af-970f-10ff26ba3835 with scrape type 2
2026-03-29 10:47:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7fc5a3a0-9801-53af-970f-10ff26ba3835, identifier: SY64199
2026-03-29 10:47:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7fc5a3a0-9801-53af-970f-10ff26ba3835 with identifier: SY64199
2026-03-29 10:47:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7fc5a3a0-9801-53af-970f-10ff26ba3835 with identifier: SY64199
2026-03-29 10:47:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7fc5a3a0-9801-53af-970f-10ff26ba3835 with identifier: SY64199 to the API
2026-03-29 10:47:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:07:04Z',
 'fuel_type': 'petrol',
 'id': '7fc5a3a0-9801-53af-970f-10ff26ba3835',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY64199',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 182142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-19',
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-29 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY64199%27 HTTP/1.1" 200 None
2026-03-29 10:47:53 [auto1.de] INFO: Saving data for SY64199: {'auction_closing_time': 1774883224.0, 'created_time': 1774694435.998221, 'last_price_update_time': 1774781273.273943}
2026-03-29 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY64199') HTTP/1.1" 204 0
2026-03-29 10:47:53 [auto1.de] INFO: Found listing with ID: ZM57049
2026-03-29 10:47:53 [auto1.de] INFO: Found listing with ID: KW41122
2026-03-29 10:47:53 [auto1.de] INFO: Found listing with ID: XV62067
2026-03-29 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV62067%27 HTTP/1.1" 200 None
2026-03-29 10:47:53 [auto1.de] INFO: Scrape type for XV62067: 2
2026-03-29 10:47:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18d97808-f0bc-552c-8bd0-eeaadb2d7ef2 with identifier: XV62067
2026-03-29 10:47:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18d97808-f0bc-552c-8bd0-eeaadb2d7ef2 with scrape type 2
2026-03-29 10:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18d97808-f0bc-552c-8bd0-eeaadb2d7ef2 with scrape type 2
2026-03-29 10:47:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18d97808-f0bc-552c-8bd0-eeaadb2d7ef2, identifier: XV62067
2026-03-29 10:47:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18d97808-f0bc-552c-8bd0-eeaadb2d7ef2 with identifier: XV62067
2026-03-29 10:47:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18d97808-f0bc-552c-8bd0-eeaadb2d7ef2 with identifier: XV62067
2026-03-29 10:47:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18d97808-f0bc-552c-8bd0-eeaadb2d7ef2 with identifier: XV62067 to the API
2026-03-29 10:47:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:41:29Z',
 'fuel_type': 'petrol',
 'id': '18d97808-f0bc-552c-8bd0-eeaadb2d7ef2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV62067',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 164146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1996-04-29',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.0',
 'transmission': 'manual',
 'trim': '',
 'year': 1996}
2026-03-29 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV62067%27 HTTP/1.1" 200 None
2026-03-29 10:47:53 [auto1.de] INFO: Saving data for XV62067: {'auction_closing_time': 1774885289.0, 'created_time': 1773945976.585571, 'last_price_update_time': 1774781273.703837}
2026-03-29 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV62067') HTTP/1.1" 204 0
2026-03-29 10:47:53 [auto1.de] INFO: Found listing with ID: EH91582
2026-03-29 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH91582%27 HTTP/1.1" 200 None
2026-03-29 10:47:53 [auto1.de] INFO: Scrape type for EH91582: 2
2026-03-29 10:47:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81a41971-c6f3-510c-954d-42f399c3ec57 with identifier: EH91582
2026-03-29 10:47:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81a41971-c6f3-510c-954d-42f399c3ec57 with scrape type 2
2026-03-29 10:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81a41971-c6f3-510c-954d-42f399c3ec57 with scrape type 2
2026-03-29 10:47:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81a41971-c6f3-510c-954d-42f399c3ec57, identifier: EH91582
2026-03-29 10:47:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81a41971-c6f3-510c-954d-42f399c3ec57 with identifier: EH91582
2026-03-29 10:47:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81a41971-c6f3-510c-954d-42f399c3ec57 with identifier: EH91582
2026-03-29 10:47:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81a41971-c6f3-510c-954d-42f399c3ec57 with identifier: EH91582 to the API
2026-03-29 10:47:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:00:45Z',
 'fuel_type': 'petrol',
 'id': '81a41971-c6f3-510c-954d-42f399c3ec57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH91582',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 105169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-02',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TSI I-Tech',
 'transmission': 'manual',
 'trim': 'I-Tech',
 'year': 2014}
2026-03-29 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH91582%27 HTTP/1.1" 200 None
2026-03-29 10:47:54 [auto1.de] INFO: Saving data for EH91582: {'auction_closing_time': 1774882845.0, 'created_time': 1774694322.227487, 'last_price_update_time': 1774781274.203985}
2026-03-29 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EH91582') HTTP/1.1" 204 0
2026-03-29 10:47:54 [auto1.de] INFO: Found listing with ID: SG58819
2026-03-29 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG58819%27 HTTP/1.1" 200 None
2026-03-29 10:47:54 [auto1.de] INFO: Scrape type for SG58819: 2
2026-03-29 10:47:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12c55a55-ee92-5264-82e0-9b651a1d2289 with identifier: SG58819
2026-03-29 10:47:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12c55a55-ee92-5264-82e0-9b651a1d2289 with scrape type 2
2026-03-29 10:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12c55a55-ee92-5264-82e0-9b651a1d2289 with scrape type 2
2026-03-29 10:47:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12c55a55-ee92-5264-82e0-9b651a1d2289, identifier: SG58819
2026-03-29 10:47:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12c55a55-ee92-5264-82e0-9b651a1d2289 with identifier: SG58819
2026-03-29 10:47:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12c55a55-ee92-5264-82e0-9b651a1d2289 with identifier: SG58819
2026-03-29 10:47:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12c55a55-ee92-5264-82e0-9b651a1d2289 with identifier: SG58819 to the API
2026-03-29 10:47:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 421,
 'expiration_date': '2026-03-30T15:54:21Z',
 'fuel_type': 'petrol',
 'id': '12c55a55-ee92-5264-82e0-9b651a1d2289',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG58819',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'G-Klasse',
 'odometer': 143946,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-27',
 'seller_name': None,
 'title': 'Mercedes-Benz G-Klasse G 500',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-29 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG58819%27 HTTP/1.1" 200 None
2026-03-29 10:47:54 [auto1.de] INFO: Saving data for SG58819: {'auction_closing_time': 1774886061.0, 'created_time': 1774349913.495331, 'last_price_update_time': 1774781274.65692}
2026-03-29 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG58819') HTTP/1.1" 204 0
2026-03-29 10:47:54 [auto1.de] INFO: Found listing with ID: EU16330
2026-03-29 10:47:54 [auto1.de] INFO: Found listing with ID: FE70575
2026-03-29 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE70575%27 HTTP/1.1" 200 None
2026-03-29 10:47:54 [auto1.de] INFO: Scrape type for FE70575: 2
2026-03-29 10:47:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45c0f44c-60b5-54b0-8222-5d08a2fb38ab with identifier: FE70575
2026-03-29 10:47:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45c0f44c-60b5-54b0-8222-5d08a2fb38ab with scrape type 2
2026-03-29 10:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45c0f44c-60b5-54b0-8222-5d08a2fb38ab with scrape type 2
2026-03-29 10:47:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45c0f44c-60b5-54b0-8222-5d08a2fb38ab, identifier: FE70575
2026-03-29 10:47:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45c0f44c-60b5-54b0-8222-5d08a2fb38ab with identifier: FE70575
2026-03-29 10:47:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45c0f44c-60b5-54b0-8222-5d08a2fb38ab with identifier: FE70575
2026-03-29 10:47:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45c0f44c-60b5-54b0-8222-5d08a2fb38ab with identifier: FE70575 to the API
2026-03-29 10:47:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:06:57Z',
 'fuel_type': 'hybrid',
 'id': '45c0f44c-60b5-54b0-8222-5d08a2fb38ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE70575',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 48393,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-21',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 250e AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-29 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE70575%27 HTTP/1.1" 200 None
2026-03-29 10:47:55 [auto1.de] INFO: Saving data for FE70575: {'auction_closing_time': 1774883217.0, 'created_time': 1774694375.387094, 'last_price_update_time': 1774781275.062028}
2026-03-29 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FE70575') HTTP/1.1" 204 0
2026-03-29 10:47:55 [auto1.de] INFO: Found listing with ID: TK97651
2026-03-29 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK97651%27 HTTP/1.1" 200 None
2026-03-29 10:47:55 [auto1.de] INFO: Scrape type for TK97651: 2
2026-03-29 10:47:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b75c04b3-7995-515e-9f2f-2cafcaffcafd with identifier: TK97651
2026-03-29 10:47:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b75c04b3-7995-515e-9f2f-2cafcaffcafd with scrape type 2
2026-03-29 10:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b75c04b3-7995-515e-9f2f-2cafcaffcafd with scrape type 2
2026-03-29 10:47:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b75c04b3-7995-515e-9f2f-2cafcaffcafd, identifier: TK97651
2026-03-29 10:47:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b75c04b3-7995-515e-9f2f-2cafcaffcafd with identifier: TK97651
2026-03-29 10:47:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b75c04b3-7995-515e-9f2f-2cafcaffcafd with identifier: TK97651
2026-03-29 10:47:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b75c04b3-7995-515e-9f2f-2cafcaffcafd with identifier: TK97651 to the API
2026-03-29 10:47:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:10:29Z',
 'fuel_type': 'diesel',
 'id': 'b75c04b3-7995-515e-9f2f-2cafcaffcafd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK97651',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 199076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-11',
 'seller_name': None,
 'title': 'Fiat Tipo 1.6 JTDM Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2016}
2026-03-29 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK97651%27 HTTP/1.1" 200 None
2026-03-29 10:47:56 [auto1.de] INFO: Saving data for TK97651: {'auction_closing_time': 1774883429.0, 'created_time': 1773946695.393411, 'last_price_update_time': 1774781276.07867}
2026-03-29 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TK97651') HTTP/1.1" 204 0
2026-03-29 10:47:56 [auto1.de] INFO: Found listing with ID: DR88922
2026-03-29 10:47:56 [auto1.de] INFO: Found listing with ID: SL55745
2026-03-29 10:47:56 [auto1.de] INFO: Found listing with ID: WA61115
2026-03-29 10:47:56 [auto1.de] INFO: Found listing with ID: SJ49235
2026-03-29 10:47:56 [auto1.de] INFO: Found listing with ID: ER21698
2026-03-29 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER21698%27 HTTP/1.1" 200 None
2026-03-29 10:47:56 [auto1.de] INFO: Scrape type for ER21698: 2
2026-03-29 10:47:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b3a2def-38e4-533c-8fe9-46a77f4b4c1a with identifier: ER21698
2026-03-29 10:47:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b3a2def-38e4-533c-8fe9-46a77f4b4c1a with scrape type 2
2026-03-29 10:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b3a2def-38e4-533c-8fe9-46a77f4b4c1a with scrape type 2
2026-03-29 10:47:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b3a2def-38e4-533c-8fe9-46a77f4b4c1a, identifier: ER21698
2026-03-29 10:47:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b3a2def-38e4-533c-8fe9-46a77f4b4c1a with identifier: ER21698
2026-03-29 10:47:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b3a2def-38e4-533c-8fe9-46a77f4b4c1a with identifier: ER21698
2026-03-29 10:47:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b3a2def-38e4-533c-8fe9-46a77f4b4c1a with identifier: ER21698 to the API
2026-03-29 10:47:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:27:48Z',
 'fuel_type': 'diesel',
 'id': '7b3a2def-38e4-533c-8fe9-46a77f4b4c1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER21698',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 92121,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-27',
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi Business VIP L2',
 'transmission': 'automatic',
 'trim': 'Business VIP L2',
 'year': 2021}
2026-03-29 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER21698%27 HTTP/1.1" 200 None
2026-03-29 10:47:56 [auto1.de] INFO: Saving data for ER21698: {'auction_closing_time': 1774884468.0, 'created_time': 1774034765.436798, 'last_price_update_time': 1774781276.774089}
2026-03-29 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ER21698') HTTP/1.1" 204 0
2026-03-29 10:47:56 [auto1.de] INFO: Found listing with ID: BT33018
2026-03-29 10:47:56 [auto1.de] INFO: Found listing with ID: DY33691
2026-03-29 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY33691%27 HTTP/1.1" 200 None
2026-03-29 10:47:56 [auto1.de] INFO: Scrape type for DY33691: 2
2026-03-29 10:47:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdca34c6-973f-594f-951f-40ea40b01917 with identifier: DY33691
2026-03-29 10:47:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdca34c6-973f-594f-951f-40ea40b01917 with scrape type 2
2026-03-29 10:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdca34c6-973f-594f-951f-40ea40b01917 with scrape type 2
2026-03-29 10:47:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bdca34c6-973f-594f-951f-40ea40b01917, identifier: DY33691
2026-03-29 10:47:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bdca34c6-973f-594f-951f-40ea40b01917 with identifier: DY33691
2026-03-29 10:47:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bdca34c6-973f-594f-951f-40ea40b01917 with identifier: DY33691
2026-03-29 10:47:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bdca34c6-973f-594f-951f-40ea40b01917 with identifier: DY33691 to the API
2026-03-29 10:47:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 285,
 'expiration_date': '2026-03-30T15:14:20Z',
 'fuel_type': 'diesel',
 'id': 'bdca34c6-973f-594f-951f-40ea40b01917',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY33691',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 263215,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-22',
 'seller_name': None,
 'title': 'BMW X5 xDrive 35d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-29 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY33691%27 HTTP/1.1" 200 None
2026-03-29 10:47:57 [auto1.de] INFO: Saving data for DY33691: {'auction_closing_time': 1774883660.0, 'created_time': 1774694317.574954, 'last_price_update_time': 1774781277.225414}
2026-03-29 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DY33691') HTTP/1.1" 204 0
2026-03-29 10:47:57 [auto1.de] INFO: Found listing with ID: KT95165
2026-03-29 10:47:57 [auto1.de] INFO: Found listing with ID: WV98635
2026-03-29 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV98635%27 HTTP/1.1" 200 None
2026-03-29 10:47:57 [auto1.de] INFO: Scrape type for WV98635: 2
2026-03-29 10:47:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7971cec-1407-5682-aca5-7e5d833ea3b9 with identifier: WV98635
2026-03-29 10:47:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7971cec-1407-5682-aca5-7e5d833ea3b9 with scrape type 2
2026-03-29 10:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7971cec-1407-5682-aca5-7e5d833ea3b9 with scrape type 2
2026-03-29 10:47:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7971cec-1407-5682-aca5-7e5d833ea3b9, identifier: WV98635
2026-03-29 10:47:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7971cec-1407-5682-aca5-7e5d833ea3b9 with identifier: WV98635
2026-03-29 10:47:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7971cec-1407-5682-aca5-7e5d833ea3b9 with identifier: WV98635
2026-03-29 10:47:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7971cec-1407-5682-aca5-7e5d833ea3b9 with identifier: WV98635 to the API
2026-03-29 10:47:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:59:00Z',
 'fuel_type': 'petrol',
 'id': 'a7971cec-1407-5682-aca5-7e5d833ea3b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV98635',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 238227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-09',
 'seller_name': None,
 'title': 'Audi A4 2.0',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-29 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV98635%27 HTTP/1.1" 200 None
2026-03-29 10:47:57 [auto1.de] INFO: Saving data for WV98635: {'auction_closing_time': 1774886340.0, 'created_time': 1773380193.808751, 'last_price_update_time': 1774781277.786536}
2026-03-29 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WV98635') HTTP/1.1" 204 0
2026-03-29 10:47:57 [auto1.de] INFO: Found listing with ID: JX65004
2026-03-29 10:47:57 [auto1.de] INFO: Found listing with ID: VG77732
2026-03-29 10:47:57 [auto1.de] INFO: Found listing with ID: MW16405
2026-03-29 10:47:57 [auto1.de] INFO: Found listing with ID: WF26983
2026-03-29 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF26983%27 HTTP/1.1" 200 None
2026-03-29 10:47:57 [auto1.de] INFO: Scrape type for WF26983: 2
2026-03-29 10:47:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5 with identifier: WF26983
2026-03-29 10:47:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5 with scrape type 2
2026-03-29 10:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5 with scrape type 2
2026-03-29 10:47:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5, identifier: WF26983
2026-03-29 10:47:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5 with identifier: WF26983
2026-03-29 10:47:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5 with identifier: WF26983
2026-03-29 10:47:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5 with identifier: WF26983 to the API
2026-03-29 10:47:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:21:05Z',
 'fuel_type': 'diesel',
 'id': '7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF26983',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 164214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-21',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-29 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF26983%27 HTTP/1.1" 200 None
2026-03-29 10:47:58 [auto1.de] INFO: Saving data for WF26983: {'auction_closing_time': 1774884065.0, 'created_time': 1774694316.954325, 'last_price_update_time': 1774781278.200556}
2026-03-29 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WF26983') HTTP/1.1" 204 0
2026-03-29 10:47:58 [auto1.de] INFO: Found listing with ID: BY24352
2026-03-29 10:47:58 [auto1.de] INFO: Found listing with ID: SV90594
2026-03-29 10:47:58 [auto1.de] INFO: Found listing with ID: CN43056
2026-03-29 10:47:58 [auto1.de] INFO: Found listing with ID: RA08562
2026-03-29 10:47:58 [auto1.de] INFO: Found listing with ID: MZ03639
2026-03-29 10:47:58 [auto1.de] INFO: Found listing with ID: EL77757
2026-03-29 10:47:58 [auto1.de] INFO: Found listing with ID: BS45971
2026-03-29 10:47:58 [auto1.de] INFO: Found listing with ID: NT95392
2026-03-29 10:47:58 [auto1.de] INFO: Found listing with ID: PB01809
2026-03-29 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB01809%27 HTTP/1.1" 200 None
2026-03-29 10:47:58 [auto1.de] INFO: Scrape type for PB01809: 2
2026-03-29 10:47:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c9efe3b-66b6-5e56-9f8d-49eec0c9e907 with identifier: PB01809
2026-03-29 10:47:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c9efe3b-66b6-5e56-9f8d-49eec0c9e907 with scrape type 2
2026-03-29 10:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c9efe3b-66b6-5e56-9f8d-49eec0c9e907 with scrape type 2
2026-03-29 10:47:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c9efe3b-66b6-5e56-9f8d-49eec0c9e907, identifier: PB01809
2026-03-29 10:47:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c9efe3b-66b6-5e56-9f8d-49eec0c9e907 with identifier: PB01809
2026-03-29 10:47:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c9efe3b-66b6-5e56-9f8d-49eec0c9e907 with identifier: PB01809
2026-03-29 10:47:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c9efe3b-66b6-5e56-9f8d-49eec0c9e907 with identifier: PB01809 to the API
2026-03-29 10:47:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:21:03Z',
 'fuel_type': 'petrol',
 'id': '7c9efe3b-66b6-5e56-9f8d-49eec0c9e907',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB01809',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 57474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-20',
 'seller_name': None,
 'title': 'Fiat 500X 1.6 Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2016}
2026-03-29 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB01809%27 HTTP/1.1" 200 None
2026-03-29 10:47:58 [auto1.de] INFO: Saving data for PB01809: {'auction_closing_time': 1774884063.0, 'created_time': 1774694318.668045, 'last_price_update_time': 1774781278.613041}
2026-03-29 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB01809') HTTP/1.1" 204 0
2026-03-29 10:47:58 [auto1.de] INFO: Found listing with ID: DA97993
2026-03-29 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA97993%27 HTTP/1.1" 200 None
2026-03-29 10:47:58 [auto1.de] INFO: Scrape type for DA97993: 2
2026-03-29 10:47:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52995c24-6e8c-547b-9aa5-966c7278154e with identifier: DA97993
2026-03-29 10:47:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52995c24-6e8c-547b-9aa5-966c7278154e with scrape type 2
2026-03-29 10:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52995c24-6e8c-547b-9aa5-966c7278154e with scrape type 2
2026-03-29 10:47:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52995c24-6e8c-547b-9aa5-966c7278154e, identifier: DA97993
2026-03-29 10:47:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52995c24-6e8c-547b-9aa5-966c7278154e with identifier: DA97993
2026-03-29 10:47:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52995c24-6e8c-547b-9aa5-966c7278154e with identifier: DA97993
2026-03-29 10:47:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52995c24-6e8c-547b-9aa5-966c7278154e with identifier: DA97993 to the API
2026-03-29 10:47:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:08:11Z',
 'fuel_type': 'diesel',
 'id': '52995c24-6e8c-547b-9aa5-966c7278154e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA97993',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 171886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-03',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Trendline BlueMotion Tech.',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech.',
 'year': 2013}
2026-03-29 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA97993%27 HTTP/1.1" 200 None
2026-03-29 10:47:59 [auto1.de] INFO: Saving data for DA97993: {'auction_closing_time': 1774883291.0, 'created_time': 1774694319.865234, 'last_price_update_time': 1774781279.113081}
2026-03-29 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DA97993') HTTP/1.1" 204 0
2026-03-29 10:47:59 [auto1.de] INFO: Found listing with ID: AD84103
2026-03-29 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD84103%27 HTTP/1.1" 200 None
2026-03-29 10:47:59 [auto1.de] INFO: Scrape type for AD84103: 2
2026-03-29 10:47:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1609c20e-b5f6-584f-a876-6176ac2bfe54 with identifier: AD84103
2026-03-29 10:47:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1609c20e-b5f6-584f-a876-6176ac2bfe54 with scrape type 2
2026-03-29 10:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1609c20e-b5f6-584f-a876-6176ac2bfe54 with scrape type 2
2026-03-29 10:47:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1609c20e-b5f6-584f-a876-6176ac2bfe54, identifier: AD84103
2026-03-29 10:47:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:47:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1609c20e-b5f6-584f-a876-6176ac2bfe54 with identifier: AD84103
2026-03-29 10:47:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1609c20e-b5f6-584f-a876-6176ac2bfe54 with identifier: AD84103
2026-03-29 10:47:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1609c20e-b5f6-584f-a876-6176ac2bfe54 with identifier: AD84103 to the API
2026-03-29 10:47:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:47:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:47:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:28:59Z',
 'fuel_type': 'petrol',
 'id': '1609c20e-b5f6-584f-a876-6176ac2bfe54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD84103',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 86235,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-13',
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 TSI Monte Carlo',
 'transmission': 'manual',
 'trim': 'Monte Carlo',
 'year': 2018}
2026-03-29 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD84103%27 HTTP/1.1" 200 None
2026-03-29 10:47:59 [auto1.de] INFO: Saving data for AD84103: {'auction_closing_time': 1774884539.0, 'created_time': 1774694340.231013, 'last_price_update_time': 1774781279.512209}
2026-03-29 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD84103') HTTP/1.1" 204 0
2026-03-29 10:47:59 [auto1.de] INFO: Found listing with ID: NV43592
2026-03-29 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV43592%27 HTTP/1.1" 200 None
2026-03-29 10:47:59 [auto1.de] INFO: Scrape type for NV43592: 2
2026-03-29 10:47:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f55ea5d-89ce-55b9-9fb0-fb45030a874c with identifier: NV43592
2026-03-29 10:47:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f55ea5d-89ce-55b9-9fb0-fb45030a874c with scrape type 2
2026-03-29 10:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f55ea5d-89ce-55b9-9fb0-fb45030a874c with scrape type 2
2026-03-29 10:47:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f55ea5d-89ce-55b9-9fb0-fb45030a874c, identifier: NV43592
2026-03-29 10:47:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f55ea5d-89ce-55b9-9fb0-fb45030a874c with identifier: NV43592
2026-03-29 10:47:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f55ea5d-89ce-55b9-9fb0-fb45030a874c with identifier: NV43592
2026-03-29 10:47:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f55ea5d-89ce-55b9-9fb0-fb45030a874c with identifier: NV43592 to the API
2026-03-29 10:47:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:45:05Z',
 'fuel_type': 'diesel',
 'id': '1f55ea5d-89ce-55b9-9fb0-fb45030a874c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV43592',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 221725,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-19',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2013}
2026-03-29 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV43592%27 HTTP/1.1" 200 None
2026-03-29 10:48:00 [auto1.de] INFO: Saving data for NV43592: {'auction_closing_time': 1774885505.0, 'created_time': 1774694322.978863, 'last_price_update_time': 1774781280.240954}
2026-03-29 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV43592') HTTP/1.1" 204 0
2026-03-29 10:48:00 [auto1.de] INFO: Found listing with ID: PL81843
2026-03-29 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL81843%27 HTTP/1.1" 200 None
2026-03-29 10:48:00 [auto1.de] INFO: Scrape type for PL81843: 2
2026-03-29 10:48:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f3806e6-ae0e-5507-8814-b80c53bb1b64 with identifier: PL81843
2026-03-29 10:48:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f3806e6-ae0e-5507-8814-b80c53bb1b64 with scrape type 2
2026-03-29 10:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f3806e6-ae0e-5507-8814-b80c53bb1b64 with scrape type 2
2026-03-29 10:48:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f3806e6-ae0e-5507-8814-b80c53bb1b64, identifier: PL81843
2026-03-29 10:48:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f3806e6-ae0e-5507-8814-b80c53bb1b64 with identifier: PL81843
2026-03-29 10:48:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f3806e6-ae0e-5507-8814-b80c53bb1b64 with identifier: PL81843
2026-03-29 10:48:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f3806e6-ae0e-5507-8814-b80c53bb1b64 with identifier: PL81843 to the API
2026-03-29 10:48:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:54:00Z',
 'fuel_type': 'petrol',
 'id': '0f3806e6-ae0e-5507-8814-b80c53bb1b64',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL81843',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 177365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-13',
 'seller_name': None,
 'title': 'Skoda Superb 1.4 TSI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2010}
2026-03-29 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL81843%27 HTTP/1.1" 200 None
2026-03-29 10:48:00 [auto1.de] INFO: Saving data for PL81843: {'auction_closing_time': 1774886040.0, 'created_time': 1773946067.150305, 'last_price_update_time': 1774781280.656917}
2026-03-29 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL81843') HTTP/1.1" 204 0
2026-03-29 10:48:00 [auto1.de] INFO: Channel: 24h | Page: 163 | totalHits: 6726 | hits on page: 40
2026-03-29 10:48:00 [auto1.de] INFO: Found listing with ID: FB20065
2026-03-29 10:48:00 [auto1.de] INFO: Found listing with ID: YV73995
2026-03-29 10:48:00 [auto1.de] INFO: Found listing with ID: WW38185
2026-03-29 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW38185%27 HTTP/1.1" 200 None
2026-03-29 10:48:00 [auto1.de] INFO: Scrape type for WW38185: 2
2026-03-29 10:48:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5e4fc3a-031c-54c8-a55c-ad86b83df945 with identifier: WW38185
2026-03-29 10:48:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5e4fc3a-031c-54c8-a55c-ad86b83df945 with scrape type 2
2026-03-29 10:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5e4fc3a-031c-54c8-a55c-ad86b83df945 with scrape type 2
2026-03-29 10:48:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5e4fc3a-031c-54c8-a55c-ad86b83df945, identifier: WW38185
2026-03-29 10:48:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:48:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5e4fc3a-031c-54c8-a55c-ad86b83df945 with identifier: WW38185
2026-03-29 10:48:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5e4fc3a-031c-54c8-a55c-ad86b83df945 with identifier: WW38185
2026-03-29 10:48:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5e4fc3a-031c-54c8-a55c-ad86b83df945 with identifier: WW38185 to the API
2026-03-29 10:48:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:19:05Z',
 'fuel_type': 'diesel',
 'id': 'c5e4fc3a-031c-54c8-a55c-ad86b83df945',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW38185',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 303451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-29',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2010}
2026-03-29 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW38185%27 HTTP/1.1" 200 None
2026-03-29 10:48:01 [auto1.de] INFO: Saving data for WW38185: {'auction_closing_time': 1774883945.0, 'created_time': 1774694308.498407, 'last_price_update_time': 1774781281.095108}
2026-03-29 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW38185') HTTP/1.1" 204 0
2026-03-29 10:48:01 [auto1.de] INFO: Found listing with ID: UW13690
2026-03-29 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW13690%27 HTTP/1.1" 200 None
2026-03-29 10:48:01 [auto1.de] INFO: Scrape type for UW13690: 2
2026-03-29 10:48:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dce7078-2a57-5825-87c4-a8037aac5212 with identifier: UW13690
2026-03-29 10:48:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dce7078-2a57-5825-87c4-a8037aac5212 with scrape type 2
2026-03-29 10:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0dce7078-2a57-5825-87c4-a8037aac5212 with scrape type 2
2026-03-29 10:48:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0dce7078-2a57-5825-87c4-a8037aac5212, identifier: UW13690
2026-03-29 10:48:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0dce7078-2a57-5825-87c4-a8037aac5212 with identifier: UW13690
2026-03-29 10:48:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0dce7078-2a57-5825-87c4-a8037aac5212 with identifier: UW13690
2026-03-29 10:48:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0dce7078-2a57-5825-87c4-a8037aac5212 with identifier: UW13690 to the API
2026-03-29 10:48:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-30T15:05:39Z',
 'fuel_type': 'diesel',
 'id': '0dce7078-2a57-5825-87c4-a8037aac5212',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW13690',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 76083,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-06',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d Mild-Hybrid T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2022}
2026-03-29 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW13690%27 HTTP/1.1" 200 None
2026-03-29 10:48:01 [auto1.de] INFO: Saving data for UW13690: {'auction_closing_time': 1774883139.0, 'created_time': 1774552702.150152, 'last_price_update_time': 1774781281.561947}
2026-03-29 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UW13690') HTTP/1.1" 204 0
2026-03-29 10:48:01 [auto1.de] INFO: Found listing with ID: CW14038
2026-03-29 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW14038%27 HTTP/1.1" 200 None
2026-03-29 10:48:01 [auto1.de] INFO: Scrape type for CW14038: 2
2026-03-29 10:48:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cae082d-9655-5aa7-9ab3-984921733949 with identifier: CW14038
2026-03-29 10:48:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cae082d-9655-5aa7-9ab3-984921733949 with scrape type 2
2026-03-29 10:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cae082d-9655-5aa7-9ab3-984921733949 with scrape type 2
2026-03-29 10:48:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0cae082d-9655-5aa7-9ab3-984921733949, identifier: CW14038
2026-03-29 10:48:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0cae082d-9655-5aa7-9ab3-984921733949 with identifier: CW14038
2026-03-29 10:48:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0cae082d-9655-5aa7-9ab3-984921733949 with identifier: CW14038
2026-03-29 10:48:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0cae082d-9655-5aa7-9ab3-984921733949 with identifier: CW14038 to the API
2026-03-29 10:48:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:48:35Z',
 'fuel_type': 'diesel',
 'id': '0cae082d-9655-5aa7-9ab3-984921733949',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW14038',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 135660,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-03',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Sportline 4x4',
 'transmission': 'automatic',
 'trim': 'Sportline 4x4',
 'year': 2022}
2026-03-29 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW14038%27 HTTP/1.1" 200 None
2026-03-29 10:48:01 [auto1.de] INFO: Saving data for CW14038: {'auction_closing_time': 1774885715.0, 'created_time': 1774694385.891554, 'last_price_update_time': 1774781281.991343}
2026-03-29 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW14038') HTTP/1.1" 204 0
2026-03-29 10:48:02 [auto1.de] INFO: Found listing with ID: HS42053
2026-03-29 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS42053%27 HTTP/1.1" 200 None
2026-03-29 10:48:02 [auto1.de] INFO: Scrape type for HS42053: 2
2026-03-29 10:48:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44147b12-2026-515b-8f70-10bce9503174 with identifier: HS42053
2026-03-29 10:48:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44147b12-2026-515b-8f70-10bce9503174 with scrape type 2
2026-03-29 10:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44147b12-2026-515b-8f70-10bce9503174 with scrape type 2
2026-03-29 10:48:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44147b12-2026-515b-8f70-10bce9503174, identifier: HS42053
2026-03-29 10:48:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44147b12-2026-515b-8f70-10bce9503174 with identifier: HS42053
2026-03-29 10:48:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44147b12-2026-515b-8f70-10bce9503174 with identifier: HS42053
2026-03-29 10:48:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44147b12-2026-515b-8f70-10bce9503174 with identifier: HS42053 to the API
2026-03-29 10:48:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:36:51Z',
 'fuel_type': 'electro',
 'id': '44147b12-2026-515b-8f70-10bce9503174',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS42053',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'ID.3',
 'odometer': 54253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-19',
 'seller_name': None,
 'title': 'Volkswagen ID.3 electric drive 150 kW Pro Performance',
 'transmission': 'automatic',
 'trim': 'Pro Performance',
 'year': 2021}
2026-03-29 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS42053%27 HTTP/1.1" 200 None
2026-03-29 10:48:02 [auto1.de] INFO: Saving data for HS42053: {'auction_closing_time': 1774885011.0, 'created_time': 1774553211.478106, 'last_price_update_time': 1774781282.463811}
2026-03-29 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HS42053') HTTP/1.1" 204 0
2026-03-29 10:48:02 [auto1.de] INFO: Found listing with ID: JX55294
2026-03-29 10:48:02 [auto1.de] INFO: Found listing with ID: PY14416
2026-03-29 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY14416%27 HTTP/1.1" 200 None
2026-03-29 10:48:02 [auto1.de] INFO: Scrape type for PY14416: 2
2026-03-29 10:48:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f3ab19c-7ba2-5bf8-9f71-95a03e60f970 with identifier: PY14416
2026-03-29 10:48:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f3ab19c-7ba2-5bf8-9f71-95a03e60f970 with scrape type 2
2026-03-29 10:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f3ab19c-7ba2-5bf8-9f71-95a03e60f970 with scrape type 2
2026-03-29 10:48:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f3ab19c-7ba2-5bf8-9f71-95a03e60f970, identifier: PY14416
2026-03-29 10:48:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f3ab19c-7ba2-5bf8-9f71-95a03e60f970 with identifier: PY14416
2026-03-29 10:48:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f3ab19c-7ba2-5bf8-9f71-95a03e60f970 with identifier: PY14416
2026-03-29 10:48:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f3ab19c-7ba2-5bf8-9f71-95a03e60f970 with identifier: PY14416 to the API
2026-03-29 10:48:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:23:24Z',
 'fuel_type': 'petrol',
 'id': '0f3ab19c-7ba2-5bf8-9f71-95a03e60f970',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY14416',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 162831,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-05',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2013}
2026-03-29 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY14416%27 HTTP/1.1" 200 None
2026-03-29 10:48:02 [auto1.de] INFO: Saving data for PY14416: {'auction_closing_time': 1774884204.0, 'created_time': 1774694349.809742, 'last_price_update_time': 1774781282.885376}
2026-03-29 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY14416') HTTP/1.1" 204 0
2026-03-29 10:48:03 [auto1.de] INFO: Found listing with ID: BK93979
2026-03-29 10:48:03 [auto1.de] INFO: Found listing with ID: DM10226
2026-03-29 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM10226%27 HTTP/1.1" 200 None
2026-03-29 10:48:03 [auto1.de] INFO: Scrape type for DM10226: 2
2026-03-29 10:48:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f4d39f2-46b2-5982-b2d2-c8a14d4e5704 with identifier: DM10226
2026-03-29 10:48:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f4d39f2-46b2-5982-b2d2-c8a14d4e5704 with scrape type 2
2026-03-29 10:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f4d39f2-46b2-5982-b2d2-c8a14d4e5704 with scrape type 2
2026-03-29 10:48:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f4d39f2-46b2-5982-b2d2-c8a14d4e5704, identifier: DM10226
2026-03-29 10:48:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f4d39f2-46b2-5982-b2d2-c8a14d4e5704 with identifier: DM10226
2026-03-29 10:48:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f4d39f2-46b2-5982-b2d2-c8a14d4e5704 with identifier: DM10226
2026-03-29 10:48:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f4d39f2-46b2-5982-b2d2-c8a14d4e5704 with identifier: DM10226 to the API
2026-03-29 10:48:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:45:50Z',
 'fuel_type': 'petrol',
 'id': '1f4d39f2-46b2-5982-b2d2-c8a14d4e5704',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM10226',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 4507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-08-29',
 'seller_name': None,
 'title': 'Opel Mokka 1.2 Turbo GS',
 'transmission': 'automatic',
 'trim': 'GS',
 'year': 2024}
2026-03-29 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM10226%27 HTTP/1.1" 200 None
2026-03-29 10:48:03 [auto1.de] INFO: Saving data for DM10226: {'auction_closing_time': 1774885550.0, 'created_time': 1774694333.867462, 'last_price_update_time': 1774781283.388756}
2026-03-29 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM10226') HTTP/1.1" 204 0
2026-03-29 10:48:03 [auto1.de] INFO: Found listing with ID: LC65511
2026-03-29 10:48:03 [auto1.de] INFO: Found listing with ID: NH74164
2026-03-29 10:48:03 [auto1.de] INFO: Found listing with ID: EE69038
2026-03-29 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE69038%27 HTTP/1.1" 200 None
2026-03-29 10:48:03 [auto1.de] INFO: Scrape type for EE69038: 2
2026-03-29 10:48:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48 with identifier: EE69038
2026-03-29 10:48:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48 with scrape type 2
2026-03-29 10:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48 with scrape type 2
2026-03-29 10:48:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48, identifier: EE69038
2026-03-29 10:48:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48 with identifier: EE69038
2026-03-29 10:48:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48 with identifier: EE69038
2026-03-29 10:48:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48 with identifier: EE69038 to the API
2026-03-29 10:48:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:02:18Z',
 'fuel_type': 'petrol',
 'id': 'f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE69038',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto Evo',
 'odometer': 154555,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-24',
 'seller_name': None,
 'title': 'Fiat Punto Evo 1.2 MyLife',
 'transmission': 'manual',
 'trim': 'MyLife',
 'year': 2011}
2026-03-29 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE69038%27 HTTP/1.1" 200 None
2026-03-29 10:48:03 [auto1.de] INFO: Saving data for EE69038: {'auction_closing_time': 1774882938.0, 'created_time': 1774694341.497831, 'last_price_update_time': 1774781283.792048}
2026-03-29 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE69038') HTTP/1.1" 204 0
2026-03-29 10:48:03 [auto1.de] INFO: Found listing with ID: PA12194
2026-03-29 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA12194%27 HTTP/1.1" 200 None
2026-03-29 10:48:03 [auto1.de] INFO: Scrape type for PA12194: 2
2026-03-29 10:48:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14b4fa88-bc89-5d07-aaf1-cba3ce7bc545 with identifier: PA12194
2026-03-29 10:48:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14b4fa88-bc89-5d07-aaf1-cba3ce7bc545 with scrape type 2
2026-03-29 10:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14b4fa88-bc89-5d07-aaf1-cba3ce7bc545 with scrape type 2
2026-03-29 10:48:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14b4fa88-bc89-5d07-aaf1-cba3ce7bc545, identifier: PA12194
2026-03-29 10:48:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14b4fa88-bc89-5d07-aaf1-cba3ce7bc545 with identifier: PA12194
2026-03-29 10:48:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14b4fa88-bc89-5d07-aaf1-cba3ce7bc545 with identifier: PA12194
2026-03-29 10:48:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14b4fa88-bc89-5d07-aaf1-cba3ce7bc545 with identifier: PA12194 to the API
2026-03-29 10:48:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:41:24Z',
 'fuel_type': 'petrol',
 'id': '14b4fa88-bc89-5d07-aaf1-cba3ce7bc545',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA12194',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 88046,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-22',
 'seller_name': None,
 'title': 'BMW 3er 320i',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-29 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA12194%27 HTTP/1.1" 200 None
2026-03-29 10:48:04 [auto1.de] INFO: Saving data for PA12194: {'auction_closing_time': 1774885284.0, 'created_time': 1774694342.309507, 'last_price_update_time': 1774781284.209893}
2026-03-29 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA12194') HTTP/1.1" 204 0
2026-03-29 10:48:04 [auto1.de] INFO: Found listing with ID: CG50140
2026-03-29 10:48:04 [auto1.de] INFO: Found listing with ID: HZ13405
2026-03-29 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ13405%27 HTTP/1.1" 200 None
2026-03-29 10:48:04 [auto1.de] INFO: Scrape type for HZ13405: 2
2026-03-29 10:48:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3eee8243-4694-54fd-abdc-e9a7f0b65314 with identifier: HZ13405
2026-03-29 10:48:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3eee8243-4694-54fd-abdc-e9a7f0b65314 with scrape type 2
2026-03-29 10:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3eee8243-4694-54fd-abdc-e9a7f0b65314 with scrape type 2
2026-03-29 10:48:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3eee8243-4694-54fd-abdc-e9a7f0b65314, identifier: HZ13405
2026-03-29 10:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:48:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3eee8243-4694-54fd-abdc-e9a7f0b65314 with identifier: HZ13405
2026-03-29 10:48:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3eee8243-4694-54fd-abdc-e9a7f0b65314 with identifier: HZ13405
2026-03-29 10:48:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3eee8243-4694-54fd-abdc-e9a7f0b65314 with identifier: HZ13405 to the API
2026-03-29 10:48:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:29:56Z',
 'fuel_type': 'diesel',
 'id': '3eee8243-4694-54fd-abdc-e9a7f0b65314',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ13405',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 168380,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-04',
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBlue TDCi Cool&Connect',
 'transmission': 'automatic',
 'trim': 'Cool&Connect',
 'year': 2018}
2026-03-29 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ13405%27 HTTP/1.1" 200 None
2026-03-29 10:48:04 [auto1.de] INFO: Saving data for HZ13405: {'auction_closing_time': 1774884596.0, 'created_time': 1774694339.786667, 'last_price_update_time': 1774781284.640482}
2026-03-29 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ13405') HTTP/1.1" 204 0
2026-03-29 10:48:04 [auto1.de] INFO: Found listing with ID: YL16347
2026-03-29 10:48:04 [auto1.de] INFO: Found listing with ID: MN41763
2026-03-29 10:48:04 [auto1.de] INFO: Found listing with ID: LU05124
2026-03-29 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU05124%27 HTTP/1.1" 200 None
2026-03-29 10:48:04 [auto1.de] INFO: Scrape type for LU05124: 2
2026-03-29 10:48:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3afa6242-ac63-57f4-8d95-e67435e84324 with identifier: LU05124
2026-03-29 10:48:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3afa6242-ac63-57f4-8d95-e67435e84324 with scrape type 2
2026-03-29 10:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3afa6242-ac63-57f4-8d95-e67435e84324 with scrape type 2
2026-03-29 10:48:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3afa6242-ac63-57f4-8d95-e67435e84324, identifier: LU05124
2026-03-29 10:48:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3afa6242-ac63-57f4-8d95-e67435e84324 with identifier: LU05124
2026-03-29 10:48:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3afa6242-ac63-57f4-8d95-e67435e84324 with identifier: LU05124
2026-03-29 10:48:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3afa6242-ac63-57f4-8d95-e67435e84324 with identifier: LU05124 to the API
2026-03-29 10:48:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:54:02Z',
 'fuel_type': 'diesel',
 'id': '3afa6242-ac63-57f4-8d95-e67435e84324',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU05124',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 187871,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-28',
 'seller_name': None,
 'title': 'Audi A1 1.6 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2013}
2026-03-29 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU05124%27 HTTP/1.1" 200 None
2026-03-29 10:48:05 [auto1.de] INFO: Saving data for LU05124: {'auction_closing_time': 1774886042.0, 'created_time': 1774350682.46448, 'last_price_update_time': 1774781285.074408}
2026-03-29 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU05124') HTTP/1.1" 204 0
2026-03-29 10:48:05 [auto1.de] INFO: Found listing with ID: SY55071
2026-03-29 10:48:05 [auto1.de] INFO: Found listing with ID: TJ50371
2026-03-29 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ50371%27 HTTP/1.1" 200 None
2026-03-29 10:48:05 [auto1.de] INFO: Scrape type for TJ50371: 2
2026-03-29 10:48:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71b4971d-294a-5961-a0bf-9ede159beb09 with identifier: TJ50371
2026-03-29 10:48:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71b4971d-294a-5961-a0bf-9ede159beb09 with scrape type 2
2026-03-29 10:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71b4971d-294a-5961-a0bf-9ede159beb09 with scrape type 2
2026-03-29 10:48:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71b4971d-294a-5961-a0bf-9ede159beb09, identifier: TJ50371
2026-03-29 10:48:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71b4971d-294a-5961-a0bf-9ede159beb09 with identifier: TJ50371
2026-03-29 10:48:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71b4971d-294a-5961-a0bf-9ede159beb09 with identifier: TJ50371
2026-03-29 10:48:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71b4971d-294a-5961-a0bf-9ede159beb09 with identifier: TJ50371 to the API
2026-03-29 10:48:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 97,
 'expiration_date': '2026-03-30T15:50:45Z',
 'fuel_type': 'petrol',
 'id': '71b4971d-294a-5961-a0bf-9ede159beb09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ50371',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Corolla',
 'odometer': 131303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-04-30',
 'seller_name': None,
 'title': 'Toyota Corolla 1.4 Sol',
 'transmission': 'manual',
 'trim': 'Sol',
 'year': 2004}
2026-03-29 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ50371%27 HTTP/1.1" 200 None
2026-03-29 10:48:05 [auto1.de] INFO: Saving data for TJ50371: {'auction_closing_time': 1774885845.0, 'created_time': 1774694332.777912, 'last_price_update_time': 1774781285.558299}
2026-03-29 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ50371') HTTP/1.1" 204 0
2026-03-29 10:48:05 [auto1.de] INFO: Channel: 24h | Page: 164 | totalHits: 6726 | hits on page: 40
2026-03-29 10:48:05 [auto1.de] INFO: Found listing with ID: WT57840
2026-03-29 10:48:05 [auto1.de] INFO: Found listing with ID: BZ34179
2026-03-29 10:48:05 [auto1.de] INFO: Found listing with ID: PA26532
2026-03-29 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA26532%27 HTTP/1.1" 200 None
2026-03-29 10:48:05 [auto1.de] INFO: Scrape type for PA26532: 2
2026-03-29 10:48:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 962d0dc1-404c-52b5-9ff2-4cbdfd71cd71 with identifier: PA26532
2026-03-29 10:48:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 962d0dc1-404c-52b5-9ff2-4cbdfd71cd71 with scrape type 2
2026-03-29 10:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 962d0dc1-404c-52b5-9ff2-4cbdfd71cd71 with scrape type 2
2026-03-29 10:48:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 962d0dc1-404c-52b5-9ff2-4cbdfd71cd71, identifier: PA26532
2026-03-29 10:48:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 962d0dc1-404c-52b5-9ff2-4cbdfd71cd71 with identifier: PA26532
2026-03-29 10:48:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 962d0dc1-404c-52b5-9ff2-4cbdfd71cd71 with identifier: PA26532
2026-03-29 10:48:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 962d0dc1-404c-52b5-9ff2-4cbdfd71cd71 with identifier: PA26532 to the API
2026-03-29 10:48:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 188,
 'expiration_date': '2026-03-30T15:49:21Z',
 'fuel_type': 'hybrid',
 'id': '962d0dc1-404c-52b5-9ff2-4cbdfd71cd71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA26532',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Eclipse Cross',
 'odometer': 48503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-11',
 'seller_name': None,
 'title': 'Mitsubishi Eclipse Cross 2.4 Plug-in Hybrid Plus Select Black 4WD',
 'transmission': 'automatic',
 'trim': 'Plus Select Black 4WD',
 'year': 2022}
2026-03-29 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA26532%27 HTTP/1.1" 200 None
2026-03-29 10:48:06 [auto1.de] INFO: Saving data for PA26532: {'auction_closing_time': 1774885761.0, 'created_time': 1774350591.579727, 'last_price_update_time': 1774781285.999948}
2026-03-29 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA26532') HTTP/1.1" 204 0
2026-03-29 10:48:06 [auto1.de] INFO: Found listing with ID: SS56268
2026-03-29 10:48:06 [auto1.de] INFO: Found listing with ID: HM38388
2026-03-29 10:48:06 [auto1.de] INFO: Found listing with ID: SA98041
2026-03-29 10:48:06 [auto1.de] INFO: Found listing with ID: RV78416
2026-03-29 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV78416%27 HTTP/1.1" 200 None
2026-03-29 10:48:06 [auto1.de] INFO: Scrape type for RV78416: 2
2026-03-29 10:48:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebc1933d-86f1-53b4-94d6-a65785ebb8db with identifier: RV78416
2026-03-29 10:48:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebc1933d-86f1-53b4-94d6-a65785ebb8db with scrape type 2
2026-03-29 10:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebc1933d-86f1-53b4-94d6-a65785ebb8db with scrape type 2
2026-03-29 10:48:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ebc1933d-86f1-53b4-94d6-a65785ebb8db, identifier: RV78416
2026-03-29 10:48:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:48:06 [auto1.de] INFO: Found listing with ID: CY89611
2026-03-29 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY89611%27 HTTP/1.1" 200 None
2026-03-29 10:48:06 [auto1.de] INFO: Scrape type for CY89611: 2
2026-03-29 10:48:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05e63a9c-5207-5003-84cf-f73000dbb885 with identifier: CY89611
2026-03-29 10:48:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05e63a9c-5207-5003-84cf-f73000dbb885 with scrape type 2
2026-03-29 10:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05e63a9c-5207-5003-84cf-f73000dbb885 with scrape type 2
2026-03-29 10:48:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05e63a9c-5207-5003-84cf-f73000dbb885, identifier: CY89611
2026-03-29 10:48:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ebc1933d-86f1-53b4-94d6-a65785ebb8db with identifier: RV78416
2026-03-29 10:48:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ebc1933d-86f1-53b4-94d6-a65785ebb8db with identifier: RV78416
2026-03-29 10:48:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ebc1933d-86f1-53b4-94d6-a65785ebb8db with identifier: RV78416 to the API
2026-03-29 10:48:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:30:05Z',
 'fuel_type': 'petrol',
 'id': 'ebc1933d-86f1-53b4-94d6-a65785ebb8db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV78416',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 138027,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-03',
 'seller_name': None,
 'title': "Kia cee'd 1.6 GDI Dream-Team",
 'transmission': 'manual',
 'trim': 'Dream-Team',
 'year': 2018}
2026-03-29 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV78416%27 HTTP/1.1" 200 None
2026-03-29 10:48:06 [auto1.de] INFO: Saving data for RV78416: {'auction_closing_time': 1774884605.0, 'created_time': 1773382621.812883, 'last_price_update_time': 1774781286.537602}
2026-03-29 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RV78416') HTTP/1.1" 204 0
2026-03-29 10:48:06 [scrapy.extensions.logstats] INFO: Crawled 226 pages (at 4 pages/min), scraped 356 items (at 71 items/min)
2026-03-29 10:48:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 160MiB
2026-03-29 10:48:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05e63a9c-5207-5003-84cf-f73000dbb885 with identifier: CY89611
2026-03-29 10:48:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05e63a9c-5207-5003-84cf-f73000dbb885 with identifier: CY89611
2026-03-29 10:48:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05e63a9c-5207-5003-84cf-f73000dbb885 with identifier: CY89611 to the API
2026-03-29 10:48:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:44:49Z',
 'fuel_type': 'petrol',
 'id': '05e63a9c-5207-5003-84cf-f73000dbb885',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY89611',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 140067,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-04',
 'seller_name': None,
 'title': 'Ford C-Max 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2014}
2026-03-29 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY89611%27 HTTP/1.1" 200 None
2026-03-29 10:48:06 [auto1.de] INFO: Saving data for CY89611: {'auction_closing_time': 1774885489.0, 'created_time': 1774694334.578788, 'last_price_update_time': 1774781286.824658}
2026-03-29 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CY89611') HTTP/1.1" 204 0
2026-03-29 10:48:06 [auto1.de] INFO: Found listing with ID: GB67844
2026-03-29 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB67844%27 HTTP/1.1" 200 None
2026-03-29 10:48:06 [auto1.de] INFO: Scrape type for GB67844: 2
2026-03-29 10:48:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb3710cd-4dd0-5ef4-9a19-c67ccb0f66f4 with identifier: GB67844
2026-03-29 10:48:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb3710cd-4dd0-5ef4-9a19-c67ccb0f66f4 with scrape type 2
2026-03-29 10:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb3710cd-4dd0-5ef4-9a19-c67ccb0f66f4 with scrape type 2
2026-03-29 10:48:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb3710cd-4dd0-5ef4-9a19-c67ccb0f66f4, identifier: GB67844
2026-03-29 10:48:06 [auto1.de] INFO: Found listing with ID: GZ42240
2026-03-29 10:48:06 [auto1.de] INFO: Found listing with ID: DV90621
2026-03-29 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV90621%27 HTTP/1.1" 200 None
2026-03-29 10:48:06 [auto1.de] INFO: Scrape type for DV90621: 2
2026-03-29 10:48:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cfc6c51-3297-5da6-937a-7825f7130efd with identifier: DV90621
2026-03-29 10:48:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cfc6c51-3297-5da6-937a-7825f7130efd with scrape type 2
2026-03-29 10:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cfc6c51-3297-5da6-937a-7825f7130efd with scrape type 2
2026-03-29 10:48:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0cfc6c51-3297-5da6-937a-7825f7130efd, identifier: DV90621
2026-03-29 10:48:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb3710cd-4dd0-5ef4-9a19-c67ccb0f66f4 with identifier: GB67844
2026-03-29 10:48:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb3710cd-4dd0-5ef4-9a19-c67ccb0f66f4 with identifier: GB67844
2026-03-29 10:48:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb3710cd-4dd0-5ef4-9a19-c67ccb0f66f4 with identifier: GB67844 to the API
2026-03-29 10:48:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:05:22Z',
 'fuel_type': 'petrol',
 'id': 'eb3710cd-4dd0-5ef4-9a19-c67ccb0f66f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB67844',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 97563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-28',
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line X',
 'transmission': 'manual',
 'trim': 'ST-Line X',
 'year': 2020}
2026-03-29 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB67844%27 HTTP/1.1" 200 None
2026-03-29 10:48:07 [auto1.de] INFO: Saving data for GB67844: {'auction_closing_time': 1774883122.0, 'created_time': 1774002058.622467, 'last_price_update_time': 1774781287.368506}
2026-03-29 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB67844') HTTP/1.1" 204 0
2026-03-29 10:48:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0cfc6c51-3297-5da6-937a-7825f7130efd with identifier: DV90621
2026-03-29 10:48:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0cfc6c51-3297-5da6-937a-7825f7130efd with identifier: DV90621
2026-03-29 10:48:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0cfc6c51-3297-5da6-937a-7825f7130efd with identifier: DV90621 to the API
2026-03-29 10:48:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:50:16Z',
 'fuel_type': 'diesel',
 'id': '0cfc6c51-3297-5da6-937a-7825f7130efd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV90621',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 330869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-22',
 'seller_name': None,
 'title': 'Peugeot 308 2.0 HDi Platinum',
 'transmission': 'automatic',
 'trim': 'Platinum',
 'year': 2010}
2026-03-29 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV90621%27 HTTP/1.1" 200 None
2026-03-29 10:48:07 [auto1.de] INFO: Saving data for DV90621: {'auction_closing_time': 1774885816.0, 'created_time': 1773428457.471864, 'last_price_update_time': 1774781287.765465}
2026-03-29 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV90621') HTTP/1.1" 204 0
2026-03-29 10:48:07 [auto1.de] INFO: Found listing with ID: GJ08958
2026-03-29 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ08958%27 HTTP/1.1" 200 None
2026-03-29 10:48:07 [auto1.de] INFO: Scrape type for GJ08958: 2
2026-03-29 10:48:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f6bdfff-f77d-502c-908b-e8357da2500d with identifier: GJ08958
2026-03-29 10:48:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f6bdfff-f77d-502c-908b-e8357da2500d with scrape type 2
2026-03-29 10:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f6bdfff-f77d-502c-908b-e8357da2500d with scrape type 2
2026-03-29 10:48:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f6bdfff-f77d-502c-908b-e8357da2500d, identifier: GJ08958
2026-03-29 10:48:07 [auto1.de] INFO: Found listing with ID: DZ63249
2026-03-29 10:48:07 [auto1.de] INFO: Found listing with ID: MN76950
2026-03-29 10:48:07 [auto1.de] INFO: Found listing with ID: AG97842
2026-03-29 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG97842%27 HTTP/1.1" 200 None
2026-03-29 10:48:07 [auto1.de] INFO: Scrape type for AG97842: 2
2026-03-29 10:48:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c00e65f-51fe-5c96-b9f6-8f699b1ebe46 with identifier: AG97842
2026-03-29 10:48:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c00e65f-51fe-5c96-b9f6-8f699b1ebe46 with scrape type 2
2026-03-29 10:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c00e65f-51fe-5c96-b9f6-8f699b1ebe46 with scrape type 2
2026-03-29 10:48:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c00e65f-51fe-5c96-b9f6-8f699b1ebe46, identifier: AG97842
2026-03-29 10:48:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f6bdfff-f77d-502c-908b-e8357da2500d with identifier: GJ08958
2026-03-29 10:48:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f6bdfff-f77d-502c-908b-e8357da2500d with identifier: GJ08958
2026-03-29 10:48:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f6bdfff-f77d-502c-908b-e8357da2500d with identifier: GJ08958 to the API
2026-03-29 10:48:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:57:21Z',
 'fuel_type': 'diesel',
 'id': '2f6bdfff-f77d-502c-908b-e8357da2500d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ08958',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 284990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-07-28',
 'seller_name': None,
 'title': 'BMW X5 3.0d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2004}
2026-03-29 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ08958%27 HTTP/1.1" 200 None
2026-03-29 10:48:08 [auto1.de] INFO: Saving data for GJ08958: {'auction_closing_time': 1774886241.0, 'created_time': 1774694400.904261, 'last_price_update_time': 1774781288.32131}
2026-03-29 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ08958') HTTP/1.1" 204 0
2026-03-29 10:48:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c00e65f-51fe-5c96-b9f6-8f699b1ebe46 with identifier: AG97842
2026-03-29 10:48:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c00e65f-51fe-5c96-b9f6-8f699b1ebe46 with identifier: AG97842
2026-03-29 10:48:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c00e65f-51fe-5c96-b9f6-8f699b1ebe46 with identifier: AG97842 to the API
2026-03-29 10:48:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:27:24Z',
 'fuel_type': 'petrol',
 'id': '9c00e65f-51fe-5c96-b9f6-8f699b1ebe46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG97842',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Dokker',
 'odometer': 88272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-25',
 'seller_name': None,
 'title': 'Dacia Dokker 1.2 TCe Laureate',
 'transmission': 'manual',
 'trim': 'Laureate',
 'year': 2017}
2026-03-29 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG97842%27 HTTP/1.1" 200 None
2026-03-29 10:48:08 [auto1.de] INFO: Saving data for AG97842: {'auction_closing_time': 1774884444.0, 'created_time': 1774694324.715576, 'last_price_update_time': 1774781288.625846}
2026-03-29 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG97842') HTTP/1.1" 204 0
2026-03-29 10:48:08 [auto1.de] INFO: Found listing with ID: HS55924
2026-03-29 10:48:08 [auto1.de] INFO: Found listing with ID: RM27503
2026-03-29 10:48:08 [auto1.de] INFO: Found listing with ID: ZD45339
2026-03-29 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD45339%27 HTTP/1.1" 200 None
2026-03-29 10:48:08 [auto1.de] INFO: Scrape type for ZD45339: 2
2026-03-29 10:48:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03910b3f-6d25-54b0-8e59-b551a22382ca with identifier: ZD45339
2026-03-29 10:48:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03910b3f-6d25-54b0-8e59-b551a22382ca with scrape type 2
2026-03-29 10:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03910b3f-6d25-54b0-8e59-b551a22382ca with scrape type 2
2026-03-29 10:48:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03910b3f-6d25-54b0-8e59-b551a22382ca, identifier: ZD45339
2026-03-29 10:48:08 [auto1.de] INFO: Found listing with ID: KV46000
2026-03-29 10:48:08 [auto1.de] INFO: Found listing with ID: LA95104
2026-03-29 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA95104%27 HTTP/1.1" 200 None
2026-03-29 10:48:08 [auto1.de] INFO: Scrape type for LA95104: 2
2026-03-29 10:48:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08 with identifier: LA95104
2026-03-29 10:48:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08 with scrape type 2
2026-03-29 10:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08 with scrape type 2
2026-03-29 10:48:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08, identifier: LA95104
2026-03-29 10:48:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03910b3f-6d25-54b0-8e59-b551a22382ca with identifier: ZD45339
2026-03-29 10:48:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03910b3f-6d25-54b0-8e59-b551a22382ca with identifier: ZD45339
2026-03-29 10:48:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03910b3f-6d25-54b0-8e59-b551a22382ca with identifier: ZD45339 to the API
2026-03-29 10:48:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:44:03Z',
 'fuel_type': 'diesel',
 'id': '03910b3f-6d25-54b0-8e59-b551a22382ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD45339',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 54260,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-05',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Wildtrak',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Wildtrak',
 'year': 2020}
2026-03-29 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD45339%27 HTTP/1.1" 200 None
2026-03-29 10:48:09 [auto1.de] INFO: Saving data for ZD45339: {'auction_closing_time': 1774885443.0, 'created_time': 1773429665.54088, 'last_price_update_time': 1774781289.133588}
2026-03-29 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD45339') HTTP/1.1" 204 0
2026-03-29 10:48:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08 with identifier: LA95104
2026-03-29 10:48:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08 with identifier: LA95104
2026-03-29 10:48:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08 with identifier: LA95104 to the API
2026-03-29 10:48:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:28:34Z',
 'fuel_type': 'petrol',
 'id': '9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA95104',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 37546,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-23',
 'seller_name': None,
 'title': 'Renault Twingo 0.9 TCe Le Coq Sportif',
 'transmission': 'automatic',
 'trim': 'Le Coq Sportif',
 'year': 2019}
2026-03-29 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA95104%27 HTTP/1.1" 200 None
2026-03-29 10:48:09 [auto1.de] INFO: Saving data for LA95104: {'auction_closing_time': 1774884514.0, 'created_time': 1774694328.313199, 'last_price_update_time': 1774781289.450547}
2026-03-29 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LA95104') HTTP/1.1" 204 0
2026-03-29 10:48:09 [auto1.de] INFO: Found listing with ID: BU26829
2026-03-29 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU26829%27 HTTP/1.1" 200 None
2026-03-29 10:48:09 [auto1.de] INFO: Scrape type for BU26829: 2
2026-03-29 10:48:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 211e999d-a1e4-5dca-86fe-7f2790d3eaf9 with identifier: BU26829
2026-03-29 10:48:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 211e999d-a1e4-5dca-86fe-7f2790d3eaf9 with scrape type 2
2026-03-29 10:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 211e999d-a1e4-5dca-86fe-7f2790d3eaf9 with scrape type 2
2026-03-29 10:48:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 211e999d-a1e4-5dca-86fe-7f2790d3eaf9, identifier: BU26829
2026-03-29 10:48:09 [auto1.de] INFO: Found listing with ID: TA12646
2026-03-29 10:48:09 [auto1.de] INFO: Found listing with ID: LX44847
2026-03-29 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX44847%27 HTTP/1.1" 200 None
2026-03-29 10:48:09 [auto1.de] INFO: Scrape type for LX44847: 2
2026-03-29 10:48:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5b185f9-2494-5a2f-b23c-65840b646c05 with identifier: LX44847
2026-03-29 10:48:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5b185f9-2494-5a2f-b23c-65840b646c05 with scrape type 2
2026-03-29 10:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5b185f9-2494-5a2f-b23c-65840b646c05 with scrape type 2
2026-03-29 10:48:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a5b185f9-2494-5a2f-b23c-65840b646c05, identifier: LX44847
2026-03-29 10:48:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 211e999d-a1e4-5dca-86fe-7f2790d3eaf9 with identifier: BU26829
2026-03-29 10:48:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 211e999d-a1e4-5dca-86fe-7f2790d3eaf9 with identifier: BU26829
2026-03-29 10:48:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 211e999d-a1e4-5dca-86fe-7f2790d3eaf9 with identifier: BU26829 to the API
2026-03-29 10:48:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:27:53Z',
 'fuel_type': 'diesel',
 'id': '211e999d-a1e4-5dca-86fe-7f2790d3eaf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU26829',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 114186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-21',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TDI Match 4Motion',
 'transmission': 'manual',
 'trim': 'Match 4Motion',
 'year': 2012}
2026-03-29 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU26829%27 HTTP/1.1" 200 None
2026-03-29 10:48:09 [auto1.de] INFO: Saving data for BU26829: {'auction_closing_time': 1774884473.0, 'created_time': 1774034010.275338, 'last_price_update_time': 1774781289.980544}
2026-03-29 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU26829') HTTP/1.1" 204 0
2026-03-29 10:48:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a5b185f9-2494-5a2f-b23c-65840b646c05 with identifier: LX44847
2026-03-29 10:48:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a5b185f9-2494-5a2f-b23c-65840b646c05 with identifier: LX44847
2026-03-29 10:48:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a5b185f9-2494-5a2f-b23c-65840b646c05 with identifier: LX44847 to the API
2026-03-29 10:48:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:00:50Z',
 'fuel_type': 'diesel',
 'id': 'a5b185f9-2494-5a2f-b23c-65840b646c05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX44847',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 194225,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-17',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2016}
2026-03-29 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX44847%27 HTTP/1.1" 200 None
2026-03-29 10:48:10 [auto1.de] INFO: Saving data for LX44847: {'auction_closing_time': 1774882850.0, 'created_time': 1774694343.77001, 'last_price_update_time': 1774781290.347863}
2026-03-29 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LX44847') HTTP/1.1" 204 0
2026-03-29 10:48:10 [auto1.de] INFO: Found listing with ID: UL74029
2026-03-29 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL74029%27 HTTP/1.1" 200 None
2026-03-29 10:48:10 [auto1.de] INFO: Scrape type for UL74029: 2
2026-03-29 10:48:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da197803-6d7a-5b47-a9f6-7fad77b4a4cb with identifier: UL74029
2026-03-29 10:48:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da197803-6d7a-5b47-a9f6-7fad77b4a4cb with scrape type 2
2026-03-29 10:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da197803-6d7a-5b47-a9f6-7fad77b4a4cb with scrape type 2
2026-03-29 10:48:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da197803-6d7a-5b47-a9f6-7fad77b4a4cb, identifier: UL74029
2026-03-29 10:48:10 [auto1.de] INFO: Found listing with ID: VG58612
2026-03-29 10:48:10 [auto1.de] INFO: Found listing with ID: LB45550
2026-03-29 10:48:10 [auto1.de] INFO: Found listing with ID: YC71395
2026-03-29 10:48:10 [auto1.de] INFO: Found listing with ID: GG20866
2026-03-29 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG20866%27 HTTP/1.1" 200 None
2026-03-29 10:48:10 [auto1.de] INFO: Scrape type for GG20866: 2
2026-03-29 10:48:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 390eeb7e-0948-53dc-b8eb-5e019d019e36 with identifier: GG20866
2026-03-29 10:48:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 390eeb7e-0948-53dc-b8eb-5e019d019e36 with scrape type 2
2026-03-29 10:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 390eeb7e-0948-53dc-b8eb-5e019d019e36 with scrape type 2
2026-03-29 10:48:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 390eeb7e-0948-53dc-b8eb-5e019d019e36, identifier: GG20866
2026-03-29 10:48:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da197803-6d7a-5b47-a9f6-7fad77b4a4cb with identifier: UL74029
2026-03-29 10:48:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da197803-6d7a-5b47-a9f6-7fad77b4a4cb with identifier: UL74029
2026-03-29 10:48:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da197803-6d7a-5b47-a9f6-7fad77b4a4cb with identifier: UL74029 to the API
2026-03-29 10:48:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:34:57Z',
 'fuel_type': 'diesel',
 'id': 'da197803-6d7a-5b47-a9f6-7fad77b4a4cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL74029',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 142197,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-04',
 'seller_name': None,
 'title': 'Ford Grand C-Max 1.5 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-29 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL74029%27 HTTP/1.1" 200 None
2026-03-29 10:48:10 [auto1.de] INFO: Saving data for UL74029: {'auction_closing_time': 1774884897.0, 'created_time': 1774032381.296751, 'last_price_update_time': 1774781290.895397}
2026-03-29 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UL74029') HTTP/1.1" 204 0
2026-03-29 10:48:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 390eeb7e-0948-53dc-b8eb-5e019d019e36 with identifier: GG20866
2026-03-29 10:48:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 390eeb7e-0948-53dc-b8eb-5e019d019e36 with identifier: GG20866
2026-03-29 10:48:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 390eeb7e-0948-53dc-b8eb-5e019d019e36 with identifier: GG20866 to the API
2026-03-29 10:48:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:59:27Z',
 'fuel_type': 'petrol',
 'id': '390eeb7e-0948-53dc-b8eb-5e019d019e36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG20866',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 160581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-18',
 'seller_name': None,
 'title': 'BMW 3er 318i',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-29 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG20866%27 HTTP/1.1" 200 None
2026-03-29 10:48:11 [auto1.de] INFO: Saving data for GG20866: {'auction_closing_time': 1774886367.0, 'created_time': 1773429035.282637, 'last_price_update_time': 1774781291.209585}
2026-03-29 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG20866') HTTP/1.1" 204 0
2026-03-29 10:48:11 [auto1.de] INFO: Found listing with ID: GB23451
2026-03-29 10:48:11 [auto1.de] INFO: Found listing with ID: GD85387
2026-03-29 10:48:11 [auto1.de] INFO: Found listing with ID: MF41650
2026-03-29 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF41650%27 HTTP/1.1" 200 None
2026-03-29 10:48:11 [auto1.de] INFO: Scrape type for MF41650: 2
2026-03-29 10:48:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 572fd3f9-1eaf-5c0f-a2ad-faf61d021577 with identifier: MF41650
2026-03-29 10:48:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 572fd3f9-1eaf-5c0f-a2ad-faf61d021577 with scrape type 2
2026-03-29 10:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 572fd3f9-1eaf-5c0f-a2ad-faf61d021577 with scrape type 2
2026-03-29 10:48:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 572fd3f9-1eaf-5c0f-a2ad-faf61d021577, identifier: MF41650
2026-03-29 10:48:11 [auto1.de] INFO: Found listing with ID: SW39146
2026-03-29 10:48:11 [auto1.de] INFO: Found listing with ID: WY65265
2026-03-29 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY65265%27 HTTP/1.1" 200 None
2026-03-29 10:48:11 [auto1.de] INFO: Scrape type for WY65265: 2
2026-03-29 10:48:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13725041-f5f9-5e70-b087-3e2c0b642cc2 with identifier: WY65265
2026-03-29 10:48:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13725041-f5f9-5e70-b087-3e2c0b642cc2 with scrape type 2
2026-03-29 10:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13725041-f5f9-5e70-b087-3e2c0b642cc2 with scrape type 2
2026-03-29 10:48:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13725041-f5f9-5e70-b087-3e2c0b642cc2, identifier: WY65265
2026-03-29 10:48:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 572fd3f9-1eaf-5c0f-a2ad-faf61d021577 with identifier: MF41650
2026-03-29 10:48:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 572fd3f9-1eaf-5c0f-a2ad-faf61d021577 with identifier: MF41650
2026-03-29 10:48:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 572fd3f9-1eaf-5c0f-a2ad-faf61d021577 with identifier: MF41650 to the API
2026-03-29 10:48:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:30:01Z',
 'fuel_type': 'petrol',
 'id': '572fd3f9-1eaf-5c0f-a2ad-faf61d021577',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF41650',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 134524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-21',
 'seller_name': None,
 'title': 'Volvo V60 2.0 T5 Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2016}
2026-03-29 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF41650%27 HTTP/1.1" 200 None
2026-03-29 10:48:11 [auto1.de] INFO: Saving data for MF41650: {'auction_closing_time': 1774884601.0, 'created_time': 1774694397.28224, 'last_price_update_time': 1774781291.764444}
2026-03-29 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF41650') HTTP/1.1" 204 0
2026-03-29 10:48:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13725041-f5f9-5e70-b087-3e2c0b642cc2 with identifier: WY65265
2026-03-29 10:48:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13725041-f5f9-5e70-b087-3e2c0b642cc2 with identifier: WY65265
2026-03-29 10:48:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13725041-f5f9-5e70-b087-3e2c0b642cc2 with identifier: WY65265 to the API
2026-03-29 10:48:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:24:03Z',
 'fuel_type': 'diesel',
 'id': '13725041-f5f9-5e70-b087-3e2c0b642cc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY65265',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 227748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-17',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-29 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY65265%27 HTTP/1.1" 200 None
2026-03-29 10:48:12 [auto1.de] INFO: Saving data for WY65265: {'auction_closing_time': 1774884243.0, 'created_time': 1773427397.877473, 'last_price_update_time': 1774781292.074019}
2026-03-29 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WY65265') HTTP/1.1" 204 0
2026-03-29 10:48:12 [auto1.de] INFO: Found listing with ID: NW01608
2026-03-29 10:48:12 [auto1.de] INFO: Found listing with ID: NV71817
2026-03-29 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV71817%27 HTTP/1.1" 200 None
2026-03-29 10:48:12 [auto1.de] INFO: Scrape type for NV71817: 2
2026-03-29 10:48:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf8e8c73-2548-5053-a372-7709a20b14be with identifier: NV71817
2026-03-29 10:48:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf8e8c73-2548-5053-a372-7709a20b14be with scrape type 2
2026-03-29 10:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf8e8c73-2548-5053-a372-7709a20b14be with scrape type 2
2026-03-29 10:48:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bf8e8c73-2548-5053-a372-7709a20b14be, identifier: NV71817
2026-03-29 10:48:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bf8e8c73-2548-5053-a372-7709a20b14be with identifier: NV71817
2026-03-29 10:48:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bf8e8c73-2548-5053-a372-7709a20b14be with identifier: NV71817
2026-03-29 10:48:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bf8e8c73-2548-5053-a372-7709a20b14be with identifier: NV71817 to the API
2026-03-29 10:48:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-30T15:36:37Z',
 'fuel_type': 'diesel',
 'id': 'bf8e8c73-2548-5053-a372-7709a20b14be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV71817',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 90699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-21',
 'seller_name': None,
 'title': 'BMW X5 xDrive 30d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-29 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV71817%27 HTTP/1.1" 200 None
2026-03-29 10:48:12 [auto1.de] INFO: Saving data for NV71817: {'auction_closing_time': 1774884997.0, 'created_time': 1774694372.771765, 'last_price_update_time': 1774781292.465622}
2026-03-29 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV71817') HTTP/1.1" 204 0
2026-03-29 10:48:12 [auto1.de] INFO: Found listing with ID: TG89658
2026-03-29 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG89658%27 HTTP/1.1" 200 None
2026-03-29 10:48:12 [auto1.de] INFO: Scrape type for TG89658: 2
2026-03-29 10:48:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c7dcc5f-6c84-569a-8caa-2acd112040b4 with identifier: TG89658
2026-03-29 10:48:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c7dcc5f-6c84-569a-8caa-2acd112040b4 with scrape type 2
2026-03-29 10:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c7dcc5f-6c84-569a-8caa-2acd112040b4 with scrape type 2
2026-03-29 10:48:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c7dcc5f-6c84-569a-8caa-2acd112040b4, identifier: TG89658
2026-03-29 10:48:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c7dcc5f-6c84-569a-8caa-2acd112040b4 with identifier: TG89658
2026-03-29 10:48:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c7dcc5f-6c84-569a-8caa-2acd112040b4 with identifier: TG89658
2026-03-29 10:48:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c7dcc5f-6c84-569a-8caa-2acd112040b4 with identifier: TG89658 to the API
2026-03-29 10:48:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:14:28Z',
 'fuel_type': 'petrol',
 'id': '8c7dcc5f-6c84-569a-8caa-2acd112040b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG89658',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 134532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-12',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.2 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2012}
2026-03-29 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG89658%27 HTTP/1.1" 200 None
2026-03-29 10:48:12 [auto1.de] INFO: Saving data for TG89658: {'auction_closing_time': 1774883668.0, 'created_time': 1773383033.276909, 'last_price_update_time': 1774781292.955776}
2026-03-29 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TG89658') HTTP/1.1" 204 0
2026-03-29 10:48:12 [auto1.de] INFO: Found listing with ID: GA70819
2026-03-29 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA70819%27 HTTP/1.1" 200 None
2026-03-29 10:48:12 [auto1.de] INFO: Scrape type for GA70819: 2
2026-03-29 10:48:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0b4b5c2-ce85-54ee-aa47-e670959110bd with identifier: GA70819
2026-03-29 10:48:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0b4b5c2-ce85-54ee-aa47-e670959110bd with scrape type 2
2026-03-29 10:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0b4b5c2-ce85-54ee-aa47-e670959110bd with scrape type 2
2026-03-29 10:48:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f0b4b5c2-ce85-54ee-aa47-e670959110bd, identifier: GA70819
2026-03-29 10:48:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f0b4b5c2-ce85-54ee-aa47-e670959110bd with identifier: GA70819
2026-03-29 10:48:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f0b4b5c2-ce85-54ee-aa47-e670959110bd with identifier: GA70819
2026-03-29 10:48:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f0b4b5c2-ce85-54ee-aa47-e670959110bd with identifier: GA70819 to the API
2026-03-29 10:48:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:22:35Z',
 'fuel_type': 'petrol',
 'id': 'f0b4b5c2-ce85-54ee-aa47-e670959110bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA70819',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 142807,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-19',
 'seller_name': None,
 'title': 'Honda CR-V 2.0 i-VTEC Lifestyle 4WD',
 'transmission': 'automatic',
 'trim': 'Lifestyle 4WD',
 'year': 2018}
2026-03-29 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA70819%27 HTTP/1.1" 200 None
2026-03-29 10:48:13 [auto1.de] INFO: Saving data for GA70819: {'auction_closing_time': 1774884155.0, 'created_time': 1774694383.603959, 'last_price_update_time': 1774781293.343522}
2026-03-29 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA70819') HTTP/1.1" 204 0
2026-03-29 10:48:13 [auto1.de] INFO: Found listing with ID: TY06085
2026-03-29 10:48:13 [auto1.de] INFO: Found listing with ID: BW55074
2026-03-29 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW55074%27 HTTP/1.1" 200 None
2026-03-29 10:48:13 [auto1.de] INFO: Scrape type for BW55074: 2
2026-03-29 10:48:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c24b8bbd-ae61-53d1-968a-013f8bc1496b with identifier: BW55074
2026-03-29 10:48:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c24b8bbd-ae61-53d1-968a-013f8bc1496b with scrape type 2
2026-03-29 10:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c24b8bbd-ae61-53d1-968a-013f8bc1496b with scrape type 2
2026-03-29 10:48:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c24b8bbd-ae61-53d1-968a-013f8bc1496b, identifier: BW55074
2026-03-29 10:48:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c24b8bbd-ae61-53d1-968a-013f8bc1496b with identifier: BW55074
2026-03-29 10:48:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c24b8bbd-ae61-53d1-968a-013f8bc1496b with identifier: BW55074
2026-03-29 10:48:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c24b8bbd-ae61-53d1-968a-013f8bc1496b with identifier: BW55074 to the API
2026-03-29 10:48:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:21:08Z',
 'fuel_type': 'petrol',
 'id': 'c24b8bbd-ae61-53d1-968a-013f8bc1496b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW55074',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'DS3',
 'odometer': 195435,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-30',
 'seller_name': None,
 'title': 'Citroen DS3 1.6 VTi SoChic',
 'transmission': 'manual',
 'trim': 'SoChic',
 'year': 2011}
2026-03-29 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW55074%27 HTTP/1.1" 200 None
2026-03-29 10:48:13 [auto1.de] INFO: Saving data for BW55074: {'auction_closing_time': 1774884068.0, 'created_time': 1774694457.789882, 'last_price_update_time': 1774781293.743795}
2026-03-29 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BW55074') HTTP/1.1" 204 0
2026-03-29 10:48:13 [auto1.de] INFO: Found listing with ID: NU23342
2026-03-29 10:48:13 [auto1.de] INFO: Found listing with ID: XE90423
2026-03-29 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE90423%27 HTTP/1.1" 200 None
2026-03-29 10:48:13 [auto1.de] INFO: Scrape type for XE90423: 2
2026-03-29 10:48:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db with identifier: XE90423
2026-03-29 10:48:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db with scrape type 2
2026-03-29 10:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db with scrape type 2
2026-03-29 10:48:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db, identifier: XE90423
2026-03-29 10:48:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db with identifier: XE90423
2026-03-29 10:48:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db with identifier: XE90423
2026-03-29 10:48:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db with identifier: XE90423 to the API
2026-03-29 10:48:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 275,
 'expiration_date': '2026-03-30T15:27:50Z',
 'fuel_type': 'petrol',
 'id': 'd2a2ebd6-dd39-5bb7-9a8e-a513bfa537db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE90423',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 119409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-18',
 'seller_name': None,
 'title': 'Hyundai i30 2.0 TGDI N Performance',
 'transmission': 'manual',
 'trim': 'N Performance',
 'year': 2019}
2026-03-29 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE90423%27 HTTP/1.1" 200 None
2026-03-29 10:48:14 [auto1.de] INFO: Saving data for XE90423: {'auction_closing_time': 1774884470.0, 'created_time': 1774694461.648944, 'last_price_update_time': 1774781294.152286}
2026-03-29 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE90423') HTTP/1.1" 204 0
2026-03-29 10:48:14 [auto1.de] INFO: Found listing with ID: SK80695
2026-03-29 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK80695%27 HTTP/1.1" 200 None
2026-03-29 10:48:14 [auto1.de] INFO: Scrape type for SK80695: 2
2026-03-29 10:48:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad with identifier: SK80695
2026-03-29 10:48:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad with scrape type 2
2026-03-29 10:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad with scrape type 2
2026-03-29 10:48:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad, identifier: SK80695
2026-03-29 10:48:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad with identifier: SK80695
2026-03-29 10:48:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad with identifier: SK80695
2026-03-29 10:48:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad with identifier: SK80695 to the API
2026-03-29 10:48:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:07:19Z',
 'fuel_type': 'petrol',
 'id': '7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK80695',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 183607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-09-25',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 150 Avantgarde',
 'transmission': 'manual',
 'trim': 'Avantgarde',
 'year': 2006}
2026-03-29 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK80695%27 HTTP/1.1" 200 None
2026-03-29 10:48:14 [auto1.de] INFO: Saving data for SK80695: {'auction_closing_time': 1774883239.0, 'created_time': 1774694453.673618, 'last_price_update_time': 1774781294.542028}
2026-03-29 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK80695') HTTP/1.1" 204 0
2026-03-29 10:48:14 [auto1.de] INFO: Found listing with ID: FL62048
2026-03-29 10:48:14 [auto1.de] INFO: Found listing with ID: DU93693
2026-03-29 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU93693%27 HTTP/1.1" 200 None
2026-03-29 10:48:14 [auto1.de] INFO: Scrape type for DU93693: 2
2026-03-29 10:48:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 455d24a2-5900-55ff-bbb8-9baf1e7d7aa1 with identifier: DU93693
2026-03-29 10:48:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 455d24a2-5900-55ff-bbb8-9baf1e7d7aa1 with scrape type 2
2026-03-29 10:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 455d24a2-5900-55ff-bbb8-9baf1e7d7aa1 with scrape type 2
2026-03-29 10:48:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 455d24a2-5900-55ff-bbb8-9baf1e7d7aa1, identifier: DU93693
2026-03-29 10:48:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 455d24a2-5900-55ff-bbb8-9baf1e7d7aa1 with identifier: DU93693
2026-03-29 10:48:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 455d24a2-5900-55ff-bbb8-9baf1e7d7aa1 with identifier: DU93693
2026-03-29 10:48:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 455d24a2-5900-55ff-bbb8-9baf1e7d7aa1 with identifier: DU93693 to the API
2026-03-29 10:48:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:10:42Z',
 'fuel_type': 'diesel',
 'id': '455d24a2-5900-55ff-bbb8-9baf1e7d7aa1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU93693',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Viano',
 'odometer': 151069,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-21',
 'seller_name': None,
 'title': 'Mercedes-Benz Viano 3.0 CDI lang Ambiente',
 'transmission': 'automatic',
 'trim': 'lang Ambiente',
 'year': 2009}
2026-03-29 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU93693%27 HTTP/1.1" 200 None
2026-03-29 10:48:14 [auto1.de] INFO: Saving data for DU93693: {'auction_closing_time': 1774883442.0, 'created_time': 1774694455.900231, 'last_price_update_time': 1774781294.936897}
2026-03-29 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DU93693') HTTP/1.1" 204 0
2026-03-29 10:48:14 [auto1.de] INFO: Found listing with ID: XV72554
2026-03-29 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV72554%27 HTTP/1.1" 200 None
2026-03-29 10:48:14 [auto1.de] INFO: Scrape type for XV72554: 2
2026-03-29 10:48:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7fa4612-196d-5fd0-8279-b54a17631155 with identifier: XV72554
2026-03-29 10:48:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7fa4612-196d-5fd0-8279-b54a17631155 with scrape type 2
2026-03-29 10:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7fa4612-196d-5fd0-8279-b54a17631155 with scrape type 2
2026-03-29 10:48:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7fa4612-196d-5fd0-8279-b54a17631155, identifier: XV72554
2026-03-29 10:48:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7fa4612-196d-5fd0-8279-b54a17631155 with identifier: XV72554
2026-03-29 10:48:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7fa4612-196d-5fd0-8279-b54a17631155 with identifier: XV72554
2026-03-29 10:48:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7fa4612-196d-5fd0-8279-b54a17631155 with identifier: XV72554 to the API
2026-03-29 10:48:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:56:15Z',
 'fuel_type': 'petrol',
 'id': 'a7fa4612-196d-5fd0-8279-b54a17631155',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV72554',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Rapid',
 'odometer': 206641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-06',
 'seller_name': None,
 'title': 'Skoda Rapid 1.2 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2013}
2026-03-29 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV72554%27 HTTP/1.1" 200 None
2026-03-29 10:48:15 [auto1.de] INFO: Saving data for XV72554: {'auction_closing_time': 1774886175.0, 'created_time': 1774694375.905778, 'last_price_update_time': 1774781295.329724}
2026-03-29 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV72554') HTTP/1.1" 204 0
2026-03-29 10:48:15 [auto1.de] INFO: Found listing with ID: RG68419
2026-03-29 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG68419%27 HTTP/1.1" 200 None
2026-03-29 10:48:15 [auto1.de] INFO: Scrape type for RG68419: 2
2026-03-29 10:48:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4f1776e-456f-5ca3-9373-159f5ed2fbfe with identifier: RG68419
2026-03-29 10:48:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4f1776e-456f-5ca3-9373-159f5ed2fbfe with scrape type 2
2026-03-29 10:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4f1776e-456f-5ca3-9373-159f5ed2fbfe with scrape type 2
2026-03-29 10:48:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4f1776e-456f-5ca3-9373-159f5ed2fbfe, identifier: RG68419
2026-03-29 10:48:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4f1776e-456f-5ca3-9373-159f5ed2fbfe with identifier: RG68419
2026-03-29 10:48:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4f1776e-456f-5ca3-9373-159f5ed2fbfe with identifier: RG68419
2026-03-29 10:48:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4f1776e-456f-5ca3-9373-159f5ed2fbfe with identifier: RG68419 to the API
2026-03-29 10:48:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:00:44Z',
 'fuel_type': 'petrol',
 'id': 'a4f1776e-456f-5ca3-9373-159f5ed2fbfe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG68419',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Ateca',
 'odometer': 58214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-26',
 'seller_name': None,
 'title': 'Cupra Ateca 2.0 TSI 4Drive',
 'transmission': 'automatic',
 'trim': '4Drive',
 'year': 2018}
2026-03-29 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG68419%27 HTTP/1.1" 200 None
2026-03-29 10:48:15 [auto1.de] INFO: Saving data for RG68419: {'auction_closing_time': 1774882844.0, 'created_time': 1774694400.512675, 'last_price_update_time': 1774781295.726487}
2026-03-29 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG68419') HTTP/1.1" 204 0
2026-03-29 10:48:15 [auto1.de] INFO: Found listing with ID: NE45887
2026-03-29 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE45887%27 HTTP/1.1" 200 None
2026-03-29 10:48:15 [auto1.de] INFO: Scrape type for NE45887: 2
2026-03-29 10:48:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 811247cf-65bd-5002-8eeb-49c701a816ee with identifier: NE45887
2026-03-29 10:48:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 811247cf-65bd-5002-8eeb-49c701a816ee with scrape type 2
2026-03-29 10:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 811247cf-65bd-5002-8eeb-49c701a816ee with scrape type 2
2026-03-29 10:48:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 811247cf-65bd-5002-8eeb-49c701a816ee, identifier: NE45887
2026-03-29 10:48:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 811247cf-65bd-5002-8eeb-49c701a816ee with identifier: NE45887
2026-03-29 10:48:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 811247cf-65bd-5002-8eeb-49c701a816ee with identifier: NE45887
2026-03-29 10:48:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 811247cf-65bd-5002-8eeb-49c701a816ee with identifier: NE45887 to the API
2026-03-29 10:48:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:14:07Z',
 'fuel_type': 'petrol',
 'id': '811247cf-65bd-5002-8eeb-49c701a816ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE45887',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 21797,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-12',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.5 eTSI Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2024}
2026-03-29 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE45887%27 HTTP/1.1" 200 None
2026-03-29 10:48:16 [auto1.de] INFO: Saving data for NE45887: {'auction_closing_time': 1774883647.0, 'created_time': 1774694431.942245, 'last_price_update_time': 1774781296.237487}
2026-03-29 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE45887') HTTP/1.1" 204 0
2026-03-29 10:48:16 [auto1.de] INFO: Found listing with ID: VZ98908
2026-03-29 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ98908%27 HTTP/1.1" 200 None
2026-03-29 10:48:16 [auto1.de] INFO: Scrape type for VZ98908: 2
2026-03-29 10:48:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af3c8a47-bd80-5dc3-936a-a72e276603f1 with identifier: VZ98908
2026-03-29 10:48:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af3c8a47-bd80-5dc3-936a-a72e276603f1 with scrape type 2
2026-03-29 10:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af3c8a47-bd80-5dc3-936a-a72e276603f1 with scrape type 2
2026-03-29 10:48:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af3c8a47-bd80-5dc3-936a-a72e276603f1, identifier: VZ98908
2026-03-29 10:48:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af3c8a47-bd80-5dc3-936a-a72e276603f1 with identifier: VZ98908
2026-03-29 10:48:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af3c8a47-bd80-5dc3-936a-a72e276603f1 with identifier: VZ98908
2026-03-29 10:48:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af3c8a47-bd80-5dc3-936a-a72e276603f1 with identifier: VZ98908 to the API
2026-03-29 10:48:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:30:01Z',
 'fuel_type': 'petrol',
 'id': 'af3c8a47-bd80-5dc3-936a-a72e276603f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ98908',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 175842,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-08',
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2009}
2026-03-29 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ98908%27 HTTP/1.1" 200 None
2026-03-29 10:48:16 [auto1.de] INFO: Saving data for VZ98908: {'auction_closing_time': 1774884601.0, 'created_time': 1774694450.682133, 'last_price_update_time': 1774781296.635206}
2026-03-29 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ98908') HTTP/1.1" 204 0
2026-03-29 10:48:16 [auto1.de] INFO: Found listing with ID: MG84960
2026-03-29 10:48:16 [auto1.de] INFO: Found listing with ID: KU56806
2026-03-29 10:48:16 [auto1.de] INFO: Found listing with ID: BH58500
2026-03-29 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH58500%27 HTTP/1.1" 200 None
2026-03-29 10:48:16 [auto1.de] INFO: Scrape type for BH58500: 2
2026-03-29 10:48:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef4b9696-1893-5928-a415-06ae470f0d36 with identifier: BH58500
2026-03-29 10:48:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef4b9696-1893-5928-a415-06ae470f0d36 with scrape type 2
2026-03-29 10:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef4b9696-1893-5928-a415-06ae470f0d36 with scrape type 2
2026-03-29 10:48:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef4b9696-1893-5928-a415-06ae470f0d36, identifier: BH58500
2026-03-29 10:48:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef4b9696-1893-5928-a415-06ae470f0d36 with identifier: BH58500
2026-03-29 10:48:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef4b9696-1893-5928-a415-06ae470f0d36 with identifier: BH58500
2026-03-29 10:48:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef4b9696-1893-5928-a415-06ae470f0d36 with identifier: BH58500 to the API
2026-03-29 10:48:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:06:56Z',
 'fuel_type': 'diesel',
 'id': 'ef4b9696-1893-5928-a415-06ae470f0d36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH58500',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 158619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-04',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-29 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH58500%27 HTTP/1.1" 200 None
2026-03-29 10:48:17 [auto1.de] INFO: Saving data for BH58500: {'auction_closing_time': 1774883216.0, 'created_time': 1774694435.327649, 'last_price_update_time': 1774781297.012903}
2026-03-29 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH58500') HTTP/1.1" 204 0
2026-03-29 10:48:17 [auto1.de] INFO: Found listing with ID: FN47599
2026-03-29 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN47599%27 HTTP/1.1" 200 None
2026-03-29 10:48:17 [auto1.de] INFO: Scrape type for FN47599: 2
2026-03-29 10:48:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92c1cde4-d2ca-50cd-beb9-b19a20d7bc99 with identifier: FN47599
2026-03-29 10:48:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92c1cde4-d2ca-50cd-beb9-b19a20d7bc99 with scrape type 2
2026-03-29 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92c1cde4-d2ca-50cd-beb9-b19a20d7bc99 with scrape type 2
2026-03-29 10:48:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 92c1cde4-d2ca-50cd-beb9-b19a20d7bc99, identifier: FN47599
2026-03-29 10:48:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 92c1cde4-d2ca-50cd-beb9-b19a20d7bc99 with identifier: FN47599
2026-03-29 10:48:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 92c1cde4-d2ca-50cd-beb9-b19a20d7bc99 with identifier: FN47599
2026-03-29 10:48:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 92c1cde4-d2ca-50cd-beb9-b19a20d7bc99 with identifier: FN47599 to the API
2026-03-29 10:48:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:46:11Z',
 'fuel_type': 'diesel',
 'id': '92c1cde4-d2ca-50cd-beb9-b19a20d7bc99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN47599',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 152055,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-13',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2018}
2026-03-29 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN47599%27 HTTP/1.1" 200 None
2026-03-29 10:48:17 [auto1.de] INFO: Saving data for FN47599: {'auction_closing_time': 1774885571.0, 'created_time': 1774694396.139286, 'last_price_update_time': 1774781297.412467}
2026-03-29 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FN47599') HTTP/1.1" 204 0
2026-03-29 10:48:17 [auto1.de] INFO: Found listing with ID: JS16399
2026-03-29 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS16399%27 HTTP/1.1" 200 None
2026-03-29 10:48:17 [auto1.de] INFO: Scrape type for JS16399: 2
2026-03-29 10:48:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 552f88f6-5c52-5f67-92aa-4ea5c77aad73 with identifier: JS16399
2026-03-29 10:48:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 552f88f6-5c52-5f67-92aa-4ea5c77aad73 with scrape type 2
2026-03-29 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 552f88f6-5c52-5f67-92aa-4ea5c77aad73 with scrape type 2
2026-03-29 10:48:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 552f88f6-5c52-5f67-92aa-4ea5c77aad73, identifier: JS16399
2026-03-29 10:48:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 552f88f6-5c52-5f67-92aa-4ea5c77aad73 with identifier: JS16399
2026-03-29 10:48:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 552f88f6-5c52-5f67-92aa-4ea5c77aad73 with identifier: JS16399
2026-03-29 10:48:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 552f88f6-5c52-5f67-92aa-4ea5c77aad73 with identifier: JS16399 to the API
2026-03-29 10:48:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:40:19Z',
 'fuel_type': 'petrol',
 'id': '552f88f6-5c52-5f67-92aa-4ea5c77aad73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS16399',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 175106,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-13',
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 High up! BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'High  BlueMotion Tech',
 'year': 2012}
2026-03-29 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS16399%27 HTTP/1.1" 200 None
2026-03-29 10:48:17 [auto1.de] INFO: Saving data for JS16399: {'auction_closing_time': 1774885219.0, 'created_time': 1774034365.785527, 'last_price_update_time': 1774781297.808487}
2026-03-29 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JS16399') HTTP/1.1" 204 0
2026-03-29 10:48:17 [auto1.de] INFO: Found listing with ID: YB04799
2026-03-29 10:48:17 [auto1.de] INFO: Found listing with ID: ME28341
2026-03-29 10:48:17 [auto1.de] INFO: Found listing with ID: JP40190
2026-03-29 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP40190%27 HTTP/1.1" 200 None
2026-03-29 10:48:17 [auto1.de] INFO: Scrape type for JP40190: 2
2026-03-29 10:48:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c51401d-33e2-5333-9397-86fdd33486ce with identifier: JP40190
2026-03-29 10:48:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c51401d-33e2-5333-9397-86fdd33486ce with scrape type 2
2026-03-29 10:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c51401d-33e2-5333-9397-86fdd33486ce with scrape type 2
2026-03-29 10:48:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c51401d-33e2-5333-9397-86fdd33486ce, identifier: JP40190
2026-03-29 10:48:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c51401d-33e2-5333-9397-86fdd33486ce with identifier: JP40190
2026-03-29 10:48:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c51401d-33e2-5333-9397-86fdd33486ce with identifier: JP40190
2026-03-29 10:48:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c51401d-33e2-5333-9397-86fdd33486ce with identifier: JP40190 to the API
2026-03-29 10:48:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:14:32Z',
 'fuel_type': 'diesel',
 'id': '8c51401d-33e2-5333-9397-86fdd33486ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP40190',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Amarok',
 'odometer': 75294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-09',
 'seller_name': None,
 'title': 'Volkswagen Amarok 3.0 V6 TDI Comfortline DoubleCab 4Motion',
 'transmission': 'automatic',
 'trim': 'Comfortline DoubleCab 4Motion',
 'year': 2019}
2026-03-29 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP40190%27 HTTP/1.1" 200 None
2026-03-29 10:48:18 [auto1.de] INFO: Saving data for JP40190: {'auction_closing_time': 1774883672.0, 'created_time': 1774002148.536693, 'last_price_update_time': 1774781298.247931}
2026-03-29 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JP40190') HTTP/1.1" 204 0
2026-03-29 10:48:18 [auto1.de] INFO: Found listing with ID: AU10222
2026-03-29 10:48:18 [auto1.de] INFO: Found listing with ID: JN77870
2026-03-29 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN77870%27 HTTP/1.1" 200 None
2026-03-29 10:48:18 [auto1.de] INFO: Scrape type for JN77870: 2
2026-03-29 10:48:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72b17b06-64e3-5e26-8752-0dc02cf8bca5 with identifier: JN77870
2026-03-29 10:48:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72b17b06-64e3-5e26-8752-0dc02cf8bca5 with scrape type 2
2026-03-29 10:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72b17b06-64e3-5e26-8752-0dc02cf8bca5 with scrape type 2
2026-03-29 10:48:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 72b17b06-64e3-5e26-8752-0dc02cf8bca5, identifier: JN77870
2026-03-29 10:48:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 72b17b06-64e3-5e26-8752-0dc02cf8bca5 with identifier: JN77870
2026-03-29 10:48:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 72b17b06-64e3-5e26-8752-0dc02cf8bca5 with identifier: JN77870
2026-03-29 10:48:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 72b17b06-64e3-5e26-8752-0dc02cf8bca5 with identifier: JN77870 to the API
2026-03-29 10:48:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 330,
 'expiration_date': '2026-03-30T15:28:06Z',
 'fuel_type': 'diesel',
 'id': '72b17b06-64e3-5e26-8752-0dc02cf8bca5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN77870',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 75850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-04',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 400 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2020}
2026-03-29 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN77870%27 HTTP/1.1" 200 None
2026-03-29 10:48:18 [auto1.de] INFO: Saving data for JN77870: {'auction_closing_time': 1774884486.0, 'created_time': 1774694399.070006, 'last_price_update_time': 1774781298.64609}
2026-03-29 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN77870') HTTP/1.1" 204 0
2026-03-29 10:48:18 [auto1.de] INFO: Found listing with ID: MN75028
2026-03-29 10:48:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:48:25 [auto1.de] INFO: Channel: 24h | Page: 165 | totalHits: 6726 | hits on page: 40
2026-03-29 10:48:25 [auto1.de] INFO: Found listing with ID: LR31578
2026-03-29 10:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR31578%27 HTTP/1.1" 200 None
2026-03-29 10:48:25 [auto1.de] INFO: Scrape type for LR31578: 2
2026-03-29 10:48:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c323a7b-2b9c-5b6a-94ee-70c153456f37 with identifier: LR31578
2026-03-29 10:48:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c323a7b-2b9c-5b6a-94ee-70c153456f37 with scrape type 2
2026-03-29 10:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c323a7b-2b9c-5b6a-94ee-70c153456f37 with scrape type 2
2026-03-29 10:48:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c323a7b-2b9c-5b6a-94ee-70c153456f37, identifier: LR31578
2026-03-29 10:48:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c323a7b-2b9c-5b6a-94ee-70c153456f37 with identifier: LR31578
2026-03-29 10:48:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c323a7b-2b9c-5b6a-94ee-70c153456f37 with identifier: LR31578
2026-03-29 10:48:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c323a7b-2b9c-5b6a-94ee-70c153456f37 with identifier: LR31578 to the API
2026-03-29 10:48:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:55:39Z',
 'fuel_type': 'petrol',
 'id': '2c323a7b-2b9c-5b6a-94ee-70c153456f37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR31578',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'MX-5',
 'odometer': 72914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-29',
 'seller_name': None,
 'title': 'Mazda MX-5 2.0 Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2017}
2026-03-29 10:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR31578%27 HTTP/1.1" 200 None
2026-03-29 10:48:25 [auto1.de] INFO: Saving data for LR31578: {'auction_closing_time': 1774886139.0, 'created_time': 1774694428.223475, 'last_price_update_time': 1774781305.639015}
2026-03-29 10:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR31578') HTTP/1.1" 204 0
2026-03-29 10:48:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:48:25 [auto1.de] INFO: Found listing with ID: SB90605
2026-03-29 10:48:25 [auto1.de] INFO: Found listing with ID: HL93382
2026-03-29 10:48:25 [auto1.de] INFO: Found listing with ID: HU71027
2026-03-29 10:48:25 [auto1.de] INFO: Found listing with ID: HW93754
2026-03-29 10:48:25 [auto1.de] INFO: Found listing with ID: KV33816
2026-03-29 10:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV33816%27 HTTP/1.1" 200 None
2026-03-29 10:48:25 [auto1.de] INFO: Scrape type for KV33816: 2
2026-03-29 10:48:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8dcc66d6-54f0-5149-a0d0-b9e82766ae85 with identifier: KV33816
2026-03-29 10:48:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dcc66d6-54f0-5149-a0d0-b9e82766ae85 with scrape type 2
2026-03-29 10:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8dcc66d6-54f0-5149-a0d0-b9e82766ae85 with scrape type 2
2026-03-29 10:48:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8dcc66d6-54f0-5149-a0d0-b9e82766ae85, identifier: KV33816
2026-03-29 10:48:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8dcc66d6-54f0-5149-a0d0-b9e82766ae85 with identifier: KV33816
2026-03-29 10:48:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8dcc66d6-54f0-5149-a0d0-b9e82766ae85 with identifier: KV33816
2026-03-29 10:48:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8dcc66d6-54f0-5149-a0d0-b9e82766ae85 with identifier: KV33816 to the API
2026-03-29 10:48:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:59:57Z',
 'fuel_type': 'diesel',
 'id': '8dcc66d6-54f0-5149-a0d0-b9e82766ae85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV33816',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 184044,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-07',
 'seller_name': None,
 'title': 'Ford Focus 1.5 TDCi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2016}
2026-03-29 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV33816%27 HTTP/1.1" 200 None
2026-03-29 10:48:26 [auto1.de] INFO: Saving data for KV33816: {'auction_closing_time': 1774886397.0, 'created_time': 1774694373.512448, 'last_price_update_time': 1774781306.122151}
2026-03-29 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV33816') HTTP/1.1" 204 0
2026-03-29 10:48:26 [auto1.de] INFO: Found listing with ID: NB68023
2026-03-29 10:48:26 [auto1.de] INFO: Found listing with ID: BG93361
2026-03-29 10:48:26 [auto1.de] INFO: Found listing with ID: ZV32018
2026-03-29 10:48:26 [auto1.de] INFO: Found listing with ID: MV90577
2026-03-29 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV90577%27 HTTP/1.1" 200 None
2026-03-29 10:48:26 [auto1.de] INFO: Scrape type for MV90577: 2
2026-03-29 10:48:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54332895-5083-5c7a-bd18-7855ded463dc with identifier: MV90577
2026-03-29 10:48:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54332895-5083-5c7a-bd18-7855ded463dc with scrape type 2
2026-03-29 10:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54332895-5083-5c7a-bd18-7855ded463dc with scrape type 2
2026-03-29 10:48:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54332895-5083-5c7a-bd18-7855ded463dc, identifier: MV90577
2026-03-29 10:48:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54332895-5083-5c7a-bd18-7855ded463dc with identifier: MV90577
2026-03-29 10:48:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54332895-5083-5c7a-bd18-7855ded463dc with identifier: MV90577
2026-03-29 10:48:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54332895-5083-5c7a-bd18-7855ded463dc with identifier: MV90577 to the API
2026-03-29 10:48:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:15:03Z',
 'fuel_type': 'diesel',
 'id': '54332895-5083-5c7a-bd18-7855ded463dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV90577',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 75676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-27',
 'seller_name': None,
 'title': 'BMW X1 xDrive 20d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-29 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV90577%27 HTTP/1.1" 200 None
2026-03-29 10:48:26 [auto1.de] INFO: Saving data for MV90577: {'auction_closing_time': 1774883703.0, 'created_time': 1774002213.526079, 'last_price_update_time': 1774781306.606431}
2026-03-29 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV90577') HTTP/1.1" 204 0
2026-03-29 10:48:26 [auto1.de] INFO: Found listing with ID: DF55649
2026-03-29 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF55649%27 HTTP/1.1" 200 None
2026-03-29 10:48:26 [auto1.de] INFO: Scrape type for DF55649: 2
2026-03-29 10:48:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1436325f-8282-5f93-be02-60a6e76a0da7 with identifier: DF55649
2026-03-29 10:48:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1436325f-8282-5f93-be02-60a6e76a0da7 with scrape type 2
2026-03-29 10:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1436325f-8282-5f93-be02-60a6e76a0da7 with scrape type 2
2026-03-29 10:48:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1436325f-8282-5f93-be02-60a6e76a0da7, identifier: DF55649
2026-03-29 10:48:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1436325f-8282-5f93-be02-60a6e76a0da7 with identifier: DF55649
2026-03-29 10:48:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1436325f-8282-5f93-be02-60a6e76a0da7 with identifier: DF55649
2026-03-29 10:48:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1436325f-8282-5f93-be02-60a6e76a0da7 with identifier: DF55649 to the API
2026-03-29 10:48:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:47:28Z',
 'fuel_type': 'petrol',
 'id': '1436325f-8282-5f93-be02-60a6e76a0da7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF55649',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 67060,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-10',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-29 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF55649%27 HTTP/1.1" 200 None
2026-03-29 10:48:27 [auto1.de] INFO: Saving data for DF55649: {'auction_closing_time': 1774885648.0, 'created_time': 1774694403.378595, 'last_price_update_time': 1774781307.365299}
2026-03-29 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF55649') HTTP/1.1" 204 0
2026-03-29 10:48:27 [auto1.de] INFO: Found listing with ID: FT64289
2026-03-29 10:48:27 [auto1.de] INFO: Found listing with ID: ED71538
2026-03-29 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED71538%27 HTTP/1.1" 200 None
2026-03-29 10:48:27 [auto1.de] INFO: Scrape type for ED71538: 2
2026-03-29 10:48:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c030561c-8927-581d-8b37-b1cfada4d831 with identifier: ED71538
2026-03-29 10:48:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c030561c-8927-581d-8b37-b1cfada4d831 with scrape type 2
2026-03-29 10:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c030561c-8927-581d-8b37-b1cfada4d831 with scrape type 2
2026-03-29 10:48:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c030561c-8927-581d-8b37-b1cfada4d831, identifier: ED71538
2026-03-29 10:48:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c030561c-8927-581d-8b37-b1cfada4d831 with identifier: ED71538
2026-03-29 10:48:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c030561c-8927-581d-8b37-b1cfada4d831 with identifier: ED71538
2026-03-29 10:48:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c030561c-8927-581d-8b37-b1cfada4d831 with identifier: ED71538 to the API
2026-03-29 10:48:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:41:52Z',
 'fuel_type': 'diesel',
 'id': 'c030561c-8927-581d-8b37-b1cfada4d831',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED71538',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Signum',
 'odometer': 189328,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-27',
 'seller_name': None,
 'title': 'Opel Signum 3.0 V6 CDTI Cosmo Plus',
 'transmission': 'automatic',
 'trim': 'Cosmo Plus',
 'year': 2007}
2026-03-29 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED71538%27 HTTP/1.1" 200 None
2026-03-29 10:48:27 [auto1.de] INFO: Saving data for ED71538: {'auction_closing_time': 1774885312.0, 'created_time': 1774694427.498074, 'last_price_update_time': 1774781307.932982}
2026-03-29 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ED71538') HTTP/1.1" 204 0
2026-03-29 10:48:27 [auto1.de] INFO: Found listing with ID: PJ47645
2026-03-29 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ47645%27 HTTP/1.1" 200 None
2026-03-29 10:48:27 [auto1.de] INFO: Scrape type for PJ47645: 2
2026-03-29 10:48:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68e16d97-69df-547f-aced-383070789b22 with identifier: PJ47645
2026-03-29 10:48:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68e16d97-69df-547f-aced-383070789b22 with scrape type 2
2026-03-29 10:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68e16d97-69df-547f-aced-383070789b22 with scrape type 2
2026-03-29 10:48:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68e16d97-69df-547f-aced-383070789b22, identifier: PJ47645
2026-03-29 10:48:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68e16d97-69df-547f-aced-383070789b22 with identifier: PJ47645
2026-03-29 10:48:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68e16d97-69df-547f-aced-383070789b22 with identifier: PJ47645
2026-03-29 10:48:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68e16d97-69df-547f-aced-383070789b22 with identifier: PJ47645 to the API
2026-03-29 10:48:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:18:47Z',
 'fuel_type': 'petrol',
 'id': '68e16d97-69df-547f-aced-383070789b22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ47645',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 162954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-18',
 'seller_name': None,
 'title': 'Ford Focus 1.6 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2011}
2026-03-29 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ47645%27 HTTP/1.1" 200 None
2026-03-29 10:48:28 [auto1.de] INFO: Saving data for PJ47645: {'auction_closing_time': 1774883927.0, 'created_time': 1774694433.273251, 'last_price_update_time': 1774781308.375586}
2026-03-29 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ47645') HTTP/1.1" 204 0
2026-03-29 10:48:28 [auto1.de] INFO: Found listing with ID: UT04321
2026-03-29 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT04321%27 HTTP/1.1" 200 None
2026-03-29 10:48:28 [auto1.de] INFO: Scrape type for UT04321: 2
2026-03-29 10:48:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8545ab6-db4b-5888-89bb-23f1749d14c9 with identifier: UT04321
2026-03-29 10:48:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8545ab6-db4b-5888-89bb-23f1749d14c9 with scrape type 2
2026-03-29 10:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8545ab6-db4b-5888-89bb-23f1749d14c9 with scrape type 2
2026-03-29 10:48:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8545ab6-db4b-5888-89bb-23f1749d14c9, identifier: UT04321
2026-03-29 10:48:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8545ab6-db4b-5888-89bb-23f1749d14c9 with identifier: UT04321
2026-03-29 10:48:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8545ab6-db4b-5888-89bb-23f1749d14c9 with identifier: UT04321
2026-03-29 10:48:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8545ab6-db4b-5888-89bb-23f1749d14c9 with identifier: UT04321 to the API
2026-03-29 10:48:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:03:04Z',
 'fuel_type': 'petrol',
 'id': 'f8545ab6-db4b-5888-89bb-23f1749d14c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT04321',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 126641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-22',
 'seller_name': None,
 'title': 'Hyundai ix35 1.6 FIFA World Cup Edition 2WD',
 'transmission': 'manual',
 'trim': 'FIFA World Cup Edition 2WD',
 'year': 2015}
2026-03-29 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT04321%27 HTTP/1.1" 200 None
2026-03-29 10:48:28 [auto1.de] INFO: Saving data for UT04321: {'auction_closing_time': 1774882984.0, 'created_time': 1774694389.337467, 'last_price_update_time': 1774781308.78763}
2026-03-29 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UT04321') HTTP/1.1" 204 0
2026-03-29 10:48:28 [auto1.de] INFO: Found listing with ID: KE10146
2026-03-29 10:48:28 [auto1.de] INFO: Found listing with ID: PN64243
2026-03-29 10:48:28 [auto1.de] INFO: Found listing with ID: DF72133
2026-03-29 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF72133%27 HTTP/1.1" 200 None
2026-03-29 10:48:28 [auto1.de] INFO: Scrape type for DF72133: 2
2026-03-29 10:48:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cabc91e-0795-5c0e-ad1c-02fa29af5462 with identifier: DF72133
2026-03-29 10:48:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cabc91e-0795-5c0e-ad1c-02fa29af5462 with scrape type 2
2026-03-29 10:48:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cabc91e-0795-5c0e-ad1c-02fa29af5462 with scrape type 2
2026-03-29 10:48:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8cabc91e-0795-5c0e-ad1c-02fa29af5462, identifier: DF72133
2026-03-29 10:48:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8cabc91e-0795-5c0e-ad1c-02fa29af5462 with identifier: DF72133
2026-03-29 10:48:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8cabc91e-0795-5c0e-ad1c-02fa29af5462 with identifier: DF72133
2026-03-29 10:48:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8cabc91e-0795-5c0e-ad1c-02fa29af5462 with identifier: DF72133 to the API
2026-03-29 10:48:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:03:43Z',
 'fuel_type': 'petrol',
 'id': '8cabc91e-0795-5c0e-ad1c-02fa29af5462',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF72133',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 191741,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-26',
 'seller_name': None,
 'title': 'Hyundai i30 1.4 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2013}
2026-03-29 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF72133%27 HTTP/1.1" 200 None
2026-03-29 10:48:29 [auto1.de] INFO: Saving data for DF72133: {'auction_closing_time': 1774883023.0, 'created_time': 1774694429.0128, 'last_price_update_time': 1774781309.196837}
2026-03-29 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF72133') HTTP/1.1" 204 0
2026-03-29 10:48:29 [auto1.de] INFO: Found listing with ID: RL77282
2026-03-29 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL77282%27 HTTP/1.1" 200 None
2026-03-29 10:48:29 [auto1.de] INFO: Scrape type for RL77282: 2
2026-03-29 10:48:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87990e2c-76dd-531a-9012-89b4b86f2f0c with identifier: RL77282
2026-03-29 10:48:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87990e2c-76dd-531a-9012-89b4b86f2f0c with scrape type 2
2026-03-29 10:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87990e2c-76dd-531a-9012-89b4b86f2f0c with scrape type 2
2026-03-29 10:48:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87990e2c-76dd-531a-9012-89b4b86f2f0c, identifier: RL77282
2026-03-29 10:48:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87990e2c-76dd-531a-9012-89b4b86f2f0c with identifier: RL77282
2026-03-29 10:48:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87990e2c-76dd-531a-9012-89b4b86f2f0c with identifier: RL77282
2026-03-29 10:48:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87990e2c-76dd-531a-9012-89b4b86f2f0c with identifier: RL77282 to the API
2026-03-29 10:48:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:57:02Z',
 'fuel_type': 'petrol',
 'id': '87990e2c-76dd-531a-9012-89b4b86f2f0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL77282',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Citigo',
 'odometer': 55312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-15',
 'seller_name': None,
 'title': 'Skoda Citigo 1.0 MPI Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2018}
2026-03-29 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL77282%27 HTTP/1.1" 200 None
2026-03-29 10:48:29 [auto1.de] INFO: Saving data for RL77282: {'auction_closing_time': 1774886222.0, 'created_time': 1774694388.097597, 'last_price_update_time': 1774781309.657309}
2026-03-29 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RL77282') HTTP/1.1" 204 0
2026-03-29 10:48:29 [auto1.de] INFO: Found listing with ID: NC99241
2026-03-29 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC99241%27 HTTP/1.1" 200 None
2026-03-29 10:48:29 [auto1.de] INFO: Scrape type for NC99241: 2
2026-03-29 10:48:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5c133de-69fe-5e04-89d3-87045991704a with identifier: NC99241
2026-03-29 10:48:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5c133de-69fe-5e04-89d3-87045991704a with scrape type 2
2026-03-29 10:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5c133de-69fe-5e04-89d3-87045991704a with scrape type 2
2026-03-29 10:48:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5c133de-69fe-5e04-89d3-87045991704a, identifier: NC99241
2026-03-29 10:48:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5c133de-69fe-5e04-89d3-87045991704a with identifier: NC99241
2026-03-29 10:48:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5c133de-69fe-5e04-89d3-87045991704a with identifier: NC99241
2026-03-29 10:48:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5c133de-69fe-5e04-89d3-87045991704a with identifier: NC99241 to the API
2026-03-29 10:48:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:36:23Z',
 'fuel_type': 'petrol',
 'id': 'c5c133de-69fe-5e04-89d3-87045991704a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC99241',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 218884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-06',
 'seller_name': None,
 'title': 'Mazda CX-5 2.0 Sports-Line AWD',
 'transmission': 'manual',
 'trim': 'Sports-Line AWD',
 'year': 2012}
2026-03-29 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC99241%27 HTTP/1.1" 200 None
2026-03-29 10:48:30 [auto1.de] INFO: Saving data for NC99241: {'auction_closing_time': 1774884983.0, 'created_time': 1774694384.193912, 'last_price_update_time': 1774781310.130888}
2026-03-29 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC99241') HTTP/1.1" 204 0
2026-03-29 10:48:30 [auto1.de] INFO: Found listing with ID: YW14341
2026-03-29 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW14341%27 HTTP/1.1" 200 None
2026-03-29 10:48:30 [auto1.de] INFO: Scrape type for YW14341: 2
2026-03-29 10:48:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61e05177-bcae-5a46-a30e-320e1cef2df7 with identifier: YW14341
2026-03-29 10:48:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61e05177-bcae-5a46-a30e-320e1cef2df7 with scrape type 2
2026-03-29 10:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61e05177-bcae-5a46-a30e-320e1cef2df7 with scrape type 2
2026-03-29 10:48:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61e05177-bcae-5a46-a30e-320e1cef2df7, identifier: YW14341
2026-03-29 10:48:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61e05177-bcae-5a46-a30e-320e1cef2df7 with identifier: YW14341
2026-03-29 10:48:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61e05177-bcae-5a46-a30e-320e1cef2df7 with identifier: YW14341
2026-03-29 10:48:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61e05177-bcae-5a46-a30e-320e1cef2df7 with identifier: YW14341 to the API
2026-03-29 10:48:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:23:30Z',
 'fuel_type': 'diesel',
 'id': '61e05177-bcae-5a46-a30e-320e1cef2df7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW14341',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 153938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-28',
 'seller_name': None,
 'title': 'Peugeot 308 2.0 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2017}
2026-03-29 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW14341%27 HTTP/1.1" 200 None
2026-03-29 10:48:30 [auto1.de] INFO: Saving data for YW14341: {'auction_closing_time': 1774884210.0, 'created_time': 1774089512.377336, 'last_price_update_time': 1774781310.556271}
2026-03-29 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YW14341') HTTP/1.1" 204 0
2026-03-29 10:48:30 [auto1.de] INFO: Found listing with ID: WH57282
2026-03-29 10:48:30 [auto1.de] INFO: Found listing with ID: SE82228
2026-03-29 10:48:30 [auto1.de] INFO: Found listing with ID: WB94546
2026-03-29 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB94546%27 HTTP/1.1" 200 None
2026-03-29 10:48:30 [auto1.de] INFO: Scrape type for WB94546: 2
2026-03-29 10:48:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60158439-dfbb-5db0-9278-aab9484e26aa with identifier: WB94546
2026-03-29 10:48:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60158439-dfbb-5db0-9278-aab9484e26aa with scrape type 2
2026-03-29 10:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60158439-dfbb-5db0-9278-aab9484e26aa with scrape type 2
2026-03-29 10:48:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60158439-dfbb-5db0-9278-aab9484e26aa, identifier: WB94546
2026-03-29 10:48:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60158439-dfbb-5db0-9278-aab9484e26aa with identifier: WB94546
2026-03-29 10:48:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60158439-dfbb-5db0-9278-aab9484e26aa with identifier: WB94546
2026-03-29 10:48:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60158439-dfbb-5db0-9278-aab9484e26aa with identifier: WB94546 to the API
2026-03-29 10:48:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:49:13Z',
 'fuel_type': 'petrol',
 'id': '60158439-dfbb-5db0-9278-aab9484e26aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB94546',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 142257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-20',
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-29 10:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB94546%27 HTTP/1.1" 200 None
2026-03-29 10:48:31 [auto1.de] INFO: Saving data for WB94546: {'auction_closing_time': 1774885753.0, 'created_time': 1774694422.65219, 'last_price_update_time': 1774781311.375634}
2026-03-29 10:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WB94546') HTTP/1.1" 204 0
2026-03-29 10:48:31 [auto1.de] INFO: Found listing with ID: LV05660
2026-03-29 10:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV05660%27 HTTP/1.1" 200 None
2026-03-29 10:48:31 [auto1.de] INFO: Scrape type for LV05660: 2
2026-03-29 10:48:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 889dd955-08a4-5d8a-83ea-3ce96c103f89 with identifier: LV05660
2026-03-29 10:48:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 889dd955-08a4-5d8a-83ea-3ce96c103f89 with scrape type 2
2026-03-29 10:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 889dd955-08a4-5d8a-83ea-3ce96c103f89 with scrape type 2
2026-03-29 10:48:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 889dd955-08a4-5d8a-83ea-3ce96c103f89, identifier: LV05660
2026-03-29 10:48:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 889dd955-08a4-5d8a-83ea-3ce96c103f89 with identifier: LV05660
2026-03-29 10:48:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 889dd955-08a4-5d8a-83ea-3ce96c103f89 with identifier: LV05660
2026-03-29 10:48:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 889dd955-08a4-5d8a-83ea-3ce96c103f89 with identifier: LV05660 to the API
2026-03-29 10:48:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:00:40Z',
 'fuel_type': 'diesel',
 'id': '889dd955-08a4-5d8a-83ea-3ce96c103f89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV05660',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'ProAce',
 'odometer': 55168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-13',
 'seller_name': None,
 'title': 'Toyota ProAce 2.0 D-4D L2 Kasten Meister',
 'transmission': 'manual',
 'trim': 'L2 Kasten Meister',
 'year': 2020}
2026-03-29 10:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV05660%27 HTTP/1.1" 200 None
2026-03-29 10:48:31 [auto1.de] INFO: Saving data for LV05660: {'auction_closing_time': 1774882840.0, 'created_time': 1774694392.088947, 'last_price_update_time': 1774781311.831634}
2026-03-29 10:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LV05660') HTTP/1.1" 204 0
2026-03-29 10:48:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:48:31 [auto1.de] INFO: Found listing with ID: ZY49257
2026-03-29 10:48:31 [auto1.de] INFO: Found listing with ID: PG18082
2026-03-29 10:48:31 [auto1.de] INFO: Found listing with ID: VX47645
2026-03-29 10:48:31 [auto1.de] INFO: Found listing with ID: UJ37250
2026-03-29 10:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ37250%27 HTTP/1.1" 200 None
2026-03-29 10:48:31 [auto1.de] INFO: Scrape type for UJ37250: 2
2026-03-29 10:48:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e56a8417-1e7d-5bca-9a99-354592d7c3b9 with identifier: UJ37250
2026-03-29 10:48:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e56a8417-1e7d-5bca-9a99-354592d7c3b9 with scrape type 2
2026-03-29 10:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e56a8417-1e7d-5bca-9a99-354592d7c3b9 with scrape type 2
2026-03-29 10:48:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e56a8417-1e7d-5bca-9a99-354592d7c3b9, identifier: UJ37250
2026-03-29 10:48:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e56a8417-1e7d-5bca-9a99-354592d7c3b9 with identifier: UJ37250
2026-03-29 10:48:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e56a8417-1e7d-5bca-9a99-354592d7c3b9 with identifier: UJ37250
2026-03-29 10:48:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e56a8417-1e7d-5bca-9a99-354592d7c3b9 with identifier: UJ37250 to the API
2026-03-29 10:48:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:47:06Z',
 'fuel_type': 'diesel',
 'id': 'e56a8417-1e7d-5bca-9a99-354592d7c3b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ37250',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 190864,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-29',
 'seller_name': None,
 'title': "Kia cee'd 1.6 CRDi GT Line",
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2015}
2026-03-29 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ37250%27 HTTP/1.1" 200 None
2026-03-29 10:48:32 [auto1.de] INFO: Saving data for UJ37250: {'auction_closing_time': 1774885626.0, 'created_time': 1774694419.277646, 'last_price_update_time': 1774781312.26052}
2026-03-29 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ37250') HTTP/1.1" 204 0
2026-03-29 10:48:32 [auto1.de] INFO: Found listing with ID: BF02767
2026-03-29 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF02767%27 HTTP/1.1" 200 None
2026-03-29 10:48:32 [auto1.de] INFO: Scrape type for BF02767: 2
2026-03-29 10:48:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2e60ed2-ad9a-5831-8ecb-e1819ca4806f with identifier: BF02767
2026-03-29 10:48:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2e60ed2-ad9a-5831-8ecb-e1819ca4806f with scrape type 2
2026-03-29 10:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2e60ed2-ad9a-5831-8ecb-e1819ca4806f with scrape type 2
2026-03-29 10:48:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2e60ed2-ad9a-5831-8ecb-e1819ca4806f, identifier: BF02767
2026-03-29 10:48:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2e60ed2-ad9a-5831-8ecb-e1819ca4806f with identifier: BF02767
2026-03-29 10:48:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2e60ed2-ad9a-5831-8ecb-e1819ca4806f with identifier: BF02767
2026-03-29 10:48:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2e60ed2-ad9a-5831-8ecb-e1819ca4806f with identifier: BF02767 to the API
2026-03-29 10:48:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:36:59Z',
 'fuel_type': 'diesel',
 'id': 'e2e60ed2-ad9a-5831-8ecb-e1819ca4806f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF02767',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 262237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-06',
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 TDCi Ghia',
 'transmission': 'manual',
 'trim': 'Ghia',
 'year': 2009}
2026-03-29 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF02767%27 HTTP/1.1" 200 None
2026-03-29 10:48:32 [auto1.de] INFO: Saving data for BF02767: {'auction_closing_time': 1774885019.0, 'created_time': 1774694381.292843, 'last_price_update_time': 1774781312.796365}
2026-03-29 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF02767') HTTP/1.1" 204 0
2026-03-29 10:48:32 [auto1.de] INFO: Found listing with ID: HX00661
2026-03-29 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX00661%27 HTTP/1.1" 200 None
2026-03-29 10:48:32 [auto1.de] INFO: Scrape type for HX00661: 2
2026-03-29 10:48:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8498033-940f-556b-8bb2-5d54e188ff29 with identifier: HX00661
2026-03-29 10:48:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8498033-940f-556b-8bb2-5d54e188ff29 with scrape type 2
2026-03-29 10:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8498033-940f-556b-8bb2-5d54e188ff29 with scrape type 2
2026-03-29 10:48:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a8498033-940f-556b-8bb2-5d54e188ff29, identifier: HX00661
2026-03-29 10:48:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a8498033-940f-556b-8bb2-5d54e188ff29 with identifier: HX00661
2026-03-29 10:48:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a8498033-940f-556b-8bb2-5d54e188ff29 with identifier: HX00661
2026-03-29 10:48:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a8498033-940f-556b-8bb2-5d54e188ff29 with identifier: HX00661 to the API
2026-03-29 10:48:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:43:06Z',
 'fuel_type': 'petrol',
 'id': 'a8498033-940f-556b-8bb2-5d54e188ff29',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX00661',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 67053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-08',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2018}
2026-03-29 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX00661%27 HTTP/1.1" 200 None
2026-03-29 10:48:33 [auto1.de] INFO: Saving data for HX00661: {'auction_closing_time': 1774885386.0, 'created_time': 1774694382.226068, 'last_price_update_time': 1774781313.237791}
2026-03-29 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX00661') HTTP/1.1" 204 0
2026-03-29 10:48:33 [auto1.de] INFO: Channel: 24h | Page: 166 | totalHits: 6726 | hits on page: 40
2026-03-29 10:48:33 [auto1.de] INFO: Found listing with ID: BV18863
2026-03-29 10:48:33 [auto1.de] INFO: Found listing with ID: RC95289
2026-03-29 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC95289%27 HTTP/1.1" 200 None
2026-03-29 10:48:33 [auto1.de] INFO: Scrape type for RC95289: 2
2026-03-29 10:48:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23321a31-5475-5504-9de8-4b2a22945016 with identifier: RC95289
2026-03-29 10:48:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23321a31-5475-5504-9de8-4b2a22945016 with scrape type 2
2026-03-29 10:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23321a31-5475-5504-9de8-4b2a22945016 with scrape type 2
2026-03-29 10:48:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23321a31-5475-5504-9de8-4b2a22945016, identifier: RC95289
2026-03-29 10:48:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23321a31-5475-5504-9de8-4b2a22945016 with identifier: RC95289
2026-03-29 10:48:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23321a31-5475-5504-9de8-4b2a22945016 with identifier: RC95289
2026-03-29 10:48:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23321a31-5475-5504-9de8-4b2a22945016 with identifier: RC95289 to the API
2026-03-29 10:48:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:21:07Z',
 'fuel_type': 'diesel',
 'id': '23321a31-5475-5504-9de8-4b2a22945016',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC95289',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 217198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-01',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2009}
2026-03-29 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC95289%27 HTTP/1.1" 200 None
2026-03-29 10:48:33 [auto1.de] INFO: Saving data for RC95289: {'auction_closing_time': 1774884067.0, 'created_time': 1773382855.197107, 'last_price_update_time': 1774781313.658792}
2026-03-29 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC95289') HTTP/1.1" 204 0
2026-03-29 10:48:33 [auto1.de] INFO: Found listing with ID: AG44580
2026-03-29 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG44580%27 HTTP/1.1" 200 None
2026-03-29 10:48:33 [auto1.de] INFO: Scrape type for AG44580: 2
2026-03-29 10:48:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d96409da-afd3-5edc-8ff4-9cc587bc71f0 with identifier: AG44580
2026-03-29 10:48:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d96409da-afd3-5edc-8ff4-9cc587bc71f0 with scrape type 2
2026-03-29 10:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d96409da-afd3-5edc-8ff4-9cc587bc71f0 with scrape type 2
2026-03-29 10:48:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d96409da-afd3-5edc-8ff4-9cc587bc71f0, identifier: AG44580
2026-03-29 10:48:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:48:33 [auto1.de] INFO: Found listing with ID: HE38410
2026-03-29 10:48:33 [auto1.de] INFO: Found listing with ID: GE96927
2026-03-29 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE96927%27 HTTP/1.1" 200 None
2026-03-29 10:48:33 [auto1.de] INFO: Scrape type for GE96927: 2
2026-03-29 10:48:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bf15954-0fd3-575b-be4b-66e59f000b7e with identifier: GE96927
2026-03-29 10:48:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bf15954-0fd3-575b-be4b-66e59f000b7e with scrape type 2
2026-03-29 10:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8bf15954-0fd3-575b-be4b-66e59f000b7e with scrape type 2
2026-03-29 10:48:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8bf15954-0fd3-575b-be4b-66e59f000b7e, identifier: GE96927
2026-03-29 10:48:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d96409da-afd3-5edc-8ff4-9cc587bc71f0 with identifier: AG44580
2026-03-29 10:48:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d96409da-afd3-5edc-8ff4-9cc587bc71f0 with identifier: AG44580
2026-03-29 10:48:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d96409da-afd3-5edc-8ff4-9cc587bc71f0 with identifier: AG44580 to the API
2026-03-29 10:48:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:36:28Z',
 'fuel_type': 'diesel',
 'id': 'd96409da-afd3-5edc-8ff4-9cc587bc71f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG44580',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 177025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-11',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-29 10:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG44580%27 HTTP/1.1" 200 None
2026-03-29 10:48:34 [auto1.de] INFO: Saving data for AG44580: {'auction_closing_time': 1774884988.0, 'created_time': 1774034982.916842, 'last_price_update_time': 1774781314.318058}
2026-03-29 10:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG44580') HTTP/1.1" 204 0
2026-03-29 10:48:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8bf15954-0fd3-575b-be4b-66e59f000b7e with identifier: GE96927
2026-03-29 10:48:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8bf15954-0fd3-575b-be4b-66e59f000b7e with identifier: GE96927
2026-03-29 10:48:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8bf15954-0fd3-575b-be4b-66e59f000b7e with identifier: GE96927 to the API
2026-03-29 10:48:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:50:26Z',
 'fuel_type': 'petrol',
 'id': '8bf15954-0fd3-575b-be4b-66e59f000b7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE96927',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 161103,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-11',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-29 10:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE96927%27 HTTP/1.1" 200 None
2026-03-29 10:48:34 [auto1.de] INFO: Saving data for GE96927: {'auction_closing_time': 1774885826.0, 'created_time': 1774694391.159504, 'last_price_update_time': 1774781314.643995}
2026-03-29 10:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE96927') HTTP/1.1" 204 0
2026-03-29 10:48:34 [auto1.de] INFO: Found listing with ID: KZ11771
2026-03-29 10:48:34 [auto1.de] INFO: Found listing with ID: RP91666
2026-03-29 10:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP91666%27 HTTP/1.1" 200 None
2026-03-29 10:48:34 [auto1.de] INFO: Scrape type for RP91666: 2
2026-03-29 10:48:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f7475fb-78f6-5fde-bfdb-5f6d62d44a88 with identifier: RP91666
2026-03-29 10:48:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f7475fb-78f6-5fde-bfdb-5f6d62d44a88 with scrape type 2
2026-03-29 10:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f7475fb-78f6-5fde-bfdb-5f6d62d44a88 with scrape type 2
2026-03-29 10:48:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f7475fb-78f6-5fde-bfdb-5f6d62d44a88, identifier: RP91666
2026-03-29 10:48:34 [auto1.de] INFO: Found listing with ID: XL36309
2026-03-29 10:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL36309%27 HTTP/1.1" 200 None
2026-03-29 10:48:34 [auto1.de] INFO: Scrape type for XL36309: 2
2026-03-29 10:48:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7d84747-dab8-5f4c-a11f-319f68f7ed1e with identifier: XL36309
2026-03-29 10:48:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7d84747-dab8-5f4c-a11f-319f68f7ed1e with scrape type 2
2026-03-29 10:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7d84747-dab8-5f4c-a11f-319f68f7ed1e with scrape type 2
2026-03-29 10:48:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e7d84747-dab8-5f4c-a11f-319f68f7ed1e, identifier: XL36309
2026-03-29 10:48:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f7475fb-78f6-5fde-bfdb-5f6d62d44a88 with identifier: RP91666
2026-03-29 10:48:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f7475fb-78f6-5fde-bfdb-5f6d62d44a88 with identifier: RP91666
2026-03-29 10:48:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f7475fb-78f6-5fde-bfdb-5f6d62d44a88 with identifier: RP91666 to the API
2026-03-29 10:48:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:31:59Z',
 'fuel_type': 'petrol',
 'id': '6f7475fb-78f6-5fde-bfdb-5f6d62d44a88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP91666',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 83960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-02',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Turbo Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-29 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP91666%27 HTTP/1.1" 200 None
2026-03-29 10:48:35 [auto1.de] INFO: Saving data for RP91666: {'auction_closing_time': 1774884719.0, 'created_time': 1773427794.434334, 'last_price_update_time': 1774781315.185067}
2026-03-29 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RP91666') HTTP/1.1" 204 0
2026-03-29 10:48:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e7d84747-dab8-5f4c-a11f-319f68f7ed1e with identifier: XL36309
2026-03-29 10:48:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e7d84747-dab8-5f4c-a11f-319f68f7ed1e with identifier: XL36309
2026-03-29 10:48:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e7d84747-dab8-5f4c-a11f-319f68f7ed1e with identifier: XL36309 to the API
2026-03-29 10:48:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:13:16Z',
 'fuel_type': 'petrol',
 'id': 'e7d84747-dab8-5f4c-a11f-319f68f7ed1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL36309',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 99065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-02',
 'seller_name': None,
 'title': 'Kia Picanto 1.1 Attract',
 'transmission': 'manual',
 'trim': 'Attract',
 'year': 2011}
2026-03-29 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL36309%27 HTTP/1.1" 200 None
2026-03-29 10:48:35 [auto1.de] INFO: Saving data for XL36309: {'auction_closing_time': 1774883596.0, 'created_time': 1774035533.588183, 'last_price_update_time': 1774781315.472241}
2026-03-29 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL36309') HTTP/1.1" 204 0
2026-03-29 10:48:35 [auto1.de] INFO: Found listing with ID: YS46144
2026-03-29 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS46144%27 HTTP/1.1" 200 None
2026-03-29 10:48:35 [auto1.de] INFO: Scrape type for YS46144: 2
2026-03-29 10:48:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6c44470-b59c-53a5-89da-d0a9941966d1 with identifier: YS46144
2026-03-29 10:48:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6c44470-b59c-53a5-89da-d0a9941966d1 with scrape type 2
2026-03-29 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6c44470-b59c-53a5-89da-d0a9941966d1 with scrape type 2
2026-03-29 10:48:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6c44470-b59c-53a5-89da-d0a9941966d1, identifier: YS46144
2026-03-29 10:48:35 [auto1.de] INFO: Found listing with ID: FM75567
2026-03-29 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM75567%27 HTTP/1.1" 200 None
2026-03-29 10:48:35 [auto1.de] INFO: Scrape type for FM75567: 2
2026-03-29 10:48:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0646a2db-3728-530c-a382-4c6cd92c5746 with identifier: FM75567
2026-03-29 10:48:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0646a2db-3728-530c-a382-4c6cd92c5746 with scrape type 2
2026-03-29 10:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0646a2db-3728-530c-a382-4c6cd92c5746 with scrape type 2
2026-03-29 10:48:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0646a2db-3728-530c-a382-4c6cd92c5746, identifier: FM75567
2026-03-29 10:48:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6c44470-b59c-53a5-89da-d0a9941966d1 with identifier: YS46144
2026-03-29 10:48:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6c44470-b59c-53a5-89da-d0a9941966d1 with identifier: YS46144
2026-03-29 10:48:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6c44470-b59c-53a5-89da-d0a9941966d1 with identifier: YS46144 to the API
2026-03-29 10:48:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 387,
 'expiration_date': '2026-03-30T15:59:34Z',
 'fuel_type': 'petrol',
 'id': 'f6c44470-b59c-53a5-89da-d0a9941966d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS46144',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 212721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-15',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 500 T 4Matic Avantgarde',
 'transmission': 'automatic',
 'trim': 'T 4Matic Avantgarde',
 'year': 2008}
2026-03-29 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS46144%27 HTTP/1.1" 200 None
2026-03-29 10:48:35 [auto1.de] INFO: Saving data for YS46144: {'auction_closing_time': 1774886374.0, 'created_time': 1773429048.268717, 'last_price_update_time': 1774781315.998998}
2026-03-29 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS46144') HTTP/1.1" 204 0
2026-03-29 10:48:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0646a2db-3728-530c-a382-4c6cd92c5746 with identifier: FM75567
2026-03-29 10:48:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0646a2db-3728-530c-a382-4c6cd92c5746 with identifier: FM75567
2026-03-29 10:48:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0646a2db-3728-530c-a382-4c6cd92c5746 with identifier: FM75567 to the API
2026-03-29 10:48:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:03:52Z',
 'fuel_type': 'diesel',
 'id': '0646a2db-3728-530c-a382-4c6cd92c5746',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM75567',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 153696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-22',
 'seller_name': None,
 'title': 'Audi A3 2.0 TDI S line Sportpaket',
 'transmission': 'manual',
 'trim': 'S line Sportpaket',
 'year': 2013}
2026-03-29 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM75567%27 HTTP/1.1" 200 None
2026-03-29 10:48:36 [auto1.de] INFO: Saving data for FM75567: {'auction_closing_time': 1774883032.0, 'created_time': 1774033948.411529, 'last_price_update_time': 1774781316.296033}
2026-03-29 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FM75567') HTTP/1.1" 204 0
2026-03-29 10:48:36 [auto1.de] INFO: Found listing with ID: BE92832
2026-03-29 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE92832%27 HTTP/1.1" 200 None
2026-03-29 10:48:36 [auto1.de] INFO: Scrape type for BE92832: 2
2026-03-29 10:48:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c919492-41be-565a-bc14-3c79d4bd00bc with identifier: BE92832
2026-03-29 10:48:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c919492-41be-565a-bc14-3c79d4bd00bc with scrape type 2
2026-03-29 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c919492-41be-565a-bc14-3c79d4bd00bc with scrape type 2
2026-03-29 10:48:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c919492-41be-565a-bc14-3c79d4bd00bc, identifier: BE92832
2026-03-29 10:48:36 [auto1.de] INFO: Found listing with ID: TU93300
2026-03-29 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU93300%27 HTTP/1.1" 200 None
2026-03-29 10:48:36 [auto1.de] INFO: Scrape type for TU93300: 2
2026-03-29 10:48:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a5a9de1-918e-5c41-bdd8-bd2d96ca775c with identifier: TU93300
2026-03-29 10:48:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a5a9de1-918e-5c41-bdd8-bd2d96ca775c with scrape type 2
2026-03-29 10:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a5a9de1-918e-5c41-bdd8-bd2d96ca775c with scrape type 2
2026-03-29 10:48:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a5a9de1-918e-5c41-bdd8-bd2d96ca775c, identifier: TU93300
2026-03-29 10:48:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c919492-41be-565a-bc14-3c79d4bd00bc with identifier: BE92832
2026-03-29 10:48:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c919492-41be-565a-bc14-3c79d4bd00bc with identifier: BE92832
2026-03-29 10:48:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c919492-41be-565a-bc14-3c79d4bd00bc with identifier: BE92832 to the API
2026-03-29 10:48:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:27:15Z',
 'fuel_type': 'petrol',
 'id': '5c919492-41be-565a-bc14-3c79d4bd00bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE92832',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Rapid',
 'odometer': 137612,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-26',
 'seller_name': None,
 'title': 'Skoda Rapid 1.2 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2015}
2026-03-29 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE92832%27 HTTP/1.1" 200 None
2026-03-29 10:48:36 [auto1.de] INFO: Saving data for BE92832: {'auction_closing_time': 1774884435.0, 'created_time': 1774350454.977619, 'last_price_update_time': 1774781316.863311}
2026-03-29 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE92832') HTTP/1.1" 204 0
2026-03-29 10:48:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a5a9de1-918e-5c41-bdd8-bd2d96ca775c with identifier: TU93300
2026-03-29 10:48:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a5a9de1-918e-5c41-bdd8-bd2d96ca775c with identifier: TU93300
2026-03-29 10:48:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a5a9de1-918e-5c41-bdd8-bd2d96ca775c with identifier: TU93300 to the API
2026-03-29 10:48:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:56:24Z',
 'fuel_type': 'diesel',
 'id': '6a5a9de1-918e-5c41-bdd8-bd2d96ca775c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU93300',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 211818,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-15',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI BlueMotion',
 'transmission': 'automatic',
 'trim': 'BlueMotion',
 'year': 2011}
2026-03-29 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU93300%27 HTTP/1.1" 200 None
2026-03-29 10:48:37 [auto1.de] INFO: Saving data for TU93300: {'auction_closing_time': 1774886184.0, 'created_time': 1774694443.482385, 'last_price_update_time': 1774781317.192234}
2026-03-29 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU93300') HTTP/1.1" 204 0
2026-03-29 10:48:37 [auto1.de] INFO: Found listing with ID: HJ16589
2026-03-29 10:48:37 [auto1.de] INFO: Found listing with ID: TN63274
2026-03-29 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN63274%27 HTTP/1.1" 200 None
2026-03-29 10:48:37 [auto1.de] INFO: Scrape type for TN63274: 2
2026-03-29 10:48:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c2e3bfb-24e1-5e24-af36-0dc40b215ad5 with identifier: TN63274
2026-03-29 10:48:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c2e3bfb-24e1-5e24-af36-0dc40b215ad5 with scrape type 2
2026-03-29 10:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c2e3bfb-24e1-5e24-af36-0dc40b215ad5 with scrape type 2
2026-03-29 10:48:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c2e3bfb-24e1-5e24-af36-0dc40b215ad5, identifier: TN63274
2026-03-29 10:48:37 [auto1.de] INFO: Found listing with ID: SH00876
2026-03-29 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH00876%27 HTTP/1.1" 200 None
2026-03-29 10:48:37 [auto1.de] INFO: Scrape type for SH00876: 2
2026-03-29 10:48:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a227b5aa-145c-54e8-b216-336963c4b36c with identifier: SH00876
2026-03-29 10:48:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a227b5aa-145c-54e8-b216-336963c4b36c with scrape type 2
2026-03-29 10:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a227b5aa-145c-54e8-b216-336963c4b36c with scrape type 2
2026-03-29 10:48:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a227b5aa-145c-54e8-b216-336963c4b36c, identifier: SH00876
2026-03-29 10:48:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c2e3bfb-24e1-5e24-af36-0dc40b215ad5 with identifier: TN63274
2026-03-29 10:48:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c2e3bfb-24e1-5e24-af36-0dc40b215ad5 with identifier: TN63274
2026-03-29 10:48:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c2e3bfb-24e1-5e24-af36-0dc40b215ad5 with identifier: TN63274 to the API
2026-03-29 10:48:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 121,
 'expiration_date': '2026-03-30T15:00:39Z',
 'fuel_type': 'petrol',
 'id': '7c2e3bfb-24e1-5e24-af36-0dc40b215ad5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN63274',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 84969,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-17',
 'seller_name': None,
 'title': 'Mazda CX-3 2.0 Skyactiv-G Exclusive-Line',
 'transmission': 'automatic',
 'trim': 'Exclusive-Line',
 'year': 2019}
2026-03-29 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN63274%27 HTTP/1.1" 200 None
2026-03-29 10:48:37 [auto1.de] INFO: Saving data for TN63274: {'auction_closing_time': 1774882839.0, 'created_time': 1774694433.660176, 'last_price_update_time': 1774781317.748613}
2026-03-29 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TN63274') HTTP/1.1" 204 0
2026-03-29 10:48:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a227b5aa-145c-54e8-b216-336963c4b36c with identifier: SH00876
2026-03-29 10:48:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a227b5aa-145c-54e8-b216-336963c4b36c with identifier: SH00876
2026-03-29 10:48:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a227b5aa-145c-54e8-b216-336963c4b36c with identifier: SH00876 to the API
2026-03-29 10:48:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:22:42Z',
 'fuel_type': 'diesel',
 'id': 'a227b5aa-145c-54e8-b216-336963c4b36c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH00876',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 129795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-13',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 250 d extralang Avantgarde',
 'transmission': 'automatic',
 'trim': 'extralang Avantgarde',
 'year': 2019}
2026-03-29 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH00876%27 HTTP/1.1" 200 None
2026-03-29 10:48:38 [auto1.de] INFO: Saving data for SH00876: {'auction_closing_time': 1774884162.0, 'created_time': 1774694460.726262, 'last_price_update_time': 1774781318.172523}
2026-03-29 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SH00876') HTTP/1.1" 204 0
2026-03-29 10:48:38 [auto1.de] INFO: Found listing with ID: BJ75751
2026-03-29 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ75751%27 HTTP/1.1" 200 None
2026-03-29 10:48:38 [auto1.de] INFO: Scrape type for BJ75751: 2
2026-03-29 10:48:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b41d75b5-76bc-56bc-bfaa-10b986b21fe6 with identifier: BJ75751
2026-03-29 10:48:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b41d75b5-76bc-56bc-bfaa-10b986b21fe6 with scrape type 2
2026-03-29 10:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b41d75b5-76bc-56bc-bfaa-10b986b21fe6 with scrape type 2
2026-03-29 10:48:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b41d75b5-76bc-56bc-bfaa-10b986b21fe6, identifier: BJ75751
2026-03-29 10:48:38 [auto1.de] INFO: Found listing with ID: YC00182
2026-03-29 10:48:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b41d75b5-76bc-56bc-bfaa-10b986b21fe6 with identifier: BJ75751
2026-03-29 10:48:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b41d75b5-76bc-56bc-bfaa-10b986b21fe6 with identifier: BJ75751
2026-03-29 10:48:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b41d75b5-76bc-56bc-bfaa-10b986b21fe6 with identifier: BJ75751 to the API
2026-03-29 10:48:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:00:24Z',
 'fuel_type': 'petrol',
 'id': 'b41d75b5-76bc-56bc-bfaa-10b986b21fe6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ75751',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 94885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-28',
 'seller_name': None,
 'title': 'MINI Countryman Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-29 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ75751%27 HTTP/1.1" 200 None
2026-03-29 10:48:38 [auto1.de] INFO: Saving data for BJ75751: {'auction_closing_time': 1774882824.0, 'created_time': 1774035456.590379, 'last_price_update_time': 1774781318.580679}
2026-03-29 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ75751') HTTP/1.1" 204 0
2026-03-29 10:48:38 [auto1.de] INFO: Found listing with ID: ZT80456
2026-03-29 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT80456%27 HTTP/1.1" 200 None
2026-03-29 10:48:38 [auto1.de] INFO: Scrape type for ZT80456: 2
2026-03-29 10:48:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 650d417b-7a87-5852-b228-2837088e2ae0 with identifier: ZT80456
2026-03-29 10:48:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 650d417b-7a87-5852-b228-2837088e2ae0 with scrape type 2
2026-03-29 10:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 650d417b-7a87-5852-b228-2837088e2ae0 with scrape type 2
2026-03-29 10:48:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 650d417b-7a87-5852-b228-2837088e2ae0, identifier: ZT80456
2026-03-29 10:48:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 650d417b-7a87-5852-b228-2837088e2ae0 with identifier: ZT80456
2026-03-29 10:48:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 650d417b-7a87-5852-b228-2837088e2ae0 with identifier: ZT80456
2026-03-29 10:48:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 650d417b-7a87-5852-b228-2837088e2ae0 with identifier: ZT80456 to the API
2026-03-29 10:48:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:40:37Z',
 'fuel_type': 'petrol',
 'id': '650d417b-7a87-5852-b228-2837088e2ae0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT80456',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Roomster',
 'odometer': 186453,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-28',
 'seller_name': None,
 'title': 'Skoda Roomster 1.4 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2009}
2026-03-29 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT80456%27 HTTP/1.1" 200 None
2026-03-29 10:48:38 [auto1.de] INFO: Saving data for ZT80456: {'auction_closing_time': 1774885237.0, 'created_time': 1773382387.080665, 'last_price_update_time': 1774781318.994322}
2026-03-29 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT80456') HTTP/1.1" 204 0
2026-03-29 10:48:39 [auto1.de] INFO: Found listing with ID: VY67413
2026-03-29 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY67413%27 HTTP/1.1" 200 None
2026-03-29 10:48:39 [auto1.de] INFO: Scrape type for VY67413: 2
2026-03-29 10:48:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f320efa-a541-547e-86fd-10375c1cc8c1 with identifier: VY67413
2026-03-29 10:48:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f320efa-a541-547e-86fd-10375c1cc8c1 with scrape type 2
2026-03-29 10:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f320efa-a541-547e-86fd-10375c1cc8c1 with scrape type 2
2026-03-29 10:48:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f320efa-a541-547e-86fd-10375c1cc8c1, identifier: VY67413
2026-03-29 10:48:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f320efa-a541-547e-86fd-10375c1cc8c1 with identifier: VY67413
2026-03-29 10:48:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f320efa-a541-547e-86fd-10375c1cc8c1 with identifier: VY67413
2026-03-29 10:48:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f320efa-a541-547e-86fd-10375c1cc8c1 with identifier: VY67413 to the API
2026-03-29 10:48:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:31:31Z',
 'fuel_type': 'petrol',
 'id': '7f320efa-a541-547e-86fd-10375c1cc8c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY67413',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'forfour',
 'odometer': 98170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-01',
 'seller_name': None,
 'title': 'Smart forfour 1.0 Basis passion',
 'transmission': 'manual',
 'trim': 'Basis passion',
 'year': 2015}
2026-03-29 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY67413%27 HTTP/1.1" 200 None
2026-03-29 10:48:39 [auto1.de] INFO: Saving data for VY67413: {'auction_closing_time': 1774884691.0, 'created_time': 1774694447.967768, 'last_price_update_time': 1774781319.402849}
2026-03-29 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY67413') HTTP/1.1" 204 0
2026-03-29 10:48:39 [auto1.de] INFO: Found listing with ID: HB69209
2026-03-29 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB69209%27 HTTP/1.1" 200 None
2026-03-29 10:48:39 [auto1.de] INFO: Scrape type for HB69209: 2
2026-03-29 10:48:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce78ea01-6141-555d-bbf1-a826460b8be7 with identifier: HB69209
2026-03-29 10:48:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce78ea01-6141-555d-bbf1-a826460b8be7 with scrape type 2
2026-03-29 10:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce78ea01-6141-555d-bbf1-a826460b8be7 with scrape type 2
2026-03-29 10:48:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce78ea01-6141-555d-bbf1-a826460b8be7, identifier: HB69209
2026-03-29 10:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:48:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce78ea01-6141-555d-bbf1-a826460b8be7 with identifier: HB69209
2026-03-29 10:48:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce78ea01-6141-555d-bbf1-a826460b8be7 with identifier: HB69209
2026-03-29 10:48:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce78ea01-6141-555d-bbf1-a826460b8be7 with identifier: HB69209 to the API
2026-03-29 10:48:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:48:46Z',
 'fuel_type': 'petrol',
 'id': 'ce78ea01-6141-555d-bbf1-a826460b8be7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB69209',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 127641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-18',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI beats',
 'transmission': 'manual',
 'trim': 'beats',
 'year': 2018}
2026-03-29 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB69209%27 HTTP/1.1" 200 None
2026-03-29 10:48:39 [auto1.de] INFO: Saving data for HB69209: {'auction_closing_time': 1774885726.0, 'created_time': 1774033894.228237, 'last_price_update_time': 1774781319.806657}
2026-03-29 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB69209') HTTP/1.1" 204 0
2026-03-29 10:48:39 [auto1.de] INFO: Found listing with ID: GF17035
2026-03-29 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF17035%27 HTTP/1.1" 200 None
2026-03-29 10:48:39 [auto1.de] INFO: Scrape type for GF17035: 2
2026-03-29 10:48:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23fa9e74-f6d3-5412-8c4a-0c67aeb4eff0 with identifier: GF17035
2026-03-29 10:48:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23fa9e74-f6d3-5412-8c4a-0c67aeb4eff0 with scrape type 2
2026-03-29 10:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23fa9e74-f6d3-5412-8c4a-0c67aeb4eff0 with scrape type 2
2026-03-29 10:48:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23fa9e74-f6d3-5412-8c4a-0c67aeb4eff0, identifier: GF17035
2026-03-29 10:48:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23fa9e74-f6d3-5412-8c4a-0c67aeb4eff0 with identifier: GF17035
2026-03-29 10:48:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23fa9e74-f6d3-5412-8c4a-0c67aeb4eff0 with identifier: GF17035
2026-03-29 10:48:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23fa9e74-f6d3-5412-8c4a-0c67aeb4eff0 with identifier: GF17035 to the API
2026-03-29 10:48:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:51:48Z',
 'fuel_type': 'petrol',
 'id': '23fa9e74-f6d3-5412-8c4a-0c67aeb4eff0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF17035',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 123319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-24',
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 VVT-i Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2010}
2026-03-29 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF17035%27 HTTP/1.1" 200 None
2026-03-29 10:48:40 [auto1.de] INFO: Saving data for GF17035: {'auction_closing_time': 1774885908.0, 'created_time': 1774003270.953743, 'last_price_update_time': 1774781320.203048}
2026-03-29 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF17035') HTTP/1.1" 204 0
2026-03-29 10:48:40 [auto1.de] INFO: Found listing with ID: KM53361
2026-03-29 10:48:40 [auto1.de] INFO: Found listing with ID: ZV63958
2026-03-29 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV63958%27 HTTP/1.1" 200 None
2026-03-29 10:48:40 [auto1.de] INFO: Scrape type for ZV63958: 2
2026-03-29 10:48:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dab3ec60-1e85-5c08-be19-0ac6f7c02853 with identifier: ZV63958
2026-03-29 10:48:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dab3ec60-1e85-5c08-be19-0ac6f7c02853 with scrape type 2
2026-03-29 10:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dab3ec60-1e85-5c08-be19-0ac6f7c02853 with scrape type 2
2026-03-29 10:48:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dab3ec60-1e85-5c08-be19-0ac6f7c02853, identifier: ZV63958
2026-03-29 10:48:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dab3ec60-1e85-5c08-be19-0ac6f7c02853 with identifier: ZV63958
2026-03-29 10:48:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dab3ec60-1e85-5c08-be19-0ac6f7c02853 with identifier: ZV63958
2026-03-29 10:48:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dab3ec60-1e85-5c08-be19-0ac6f7c02853 with identifier: ZV63958 to the API
2026-03-29 10:48:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:37:28Z',
 'fuel_type': 'petrol',
 'id': 'dab3ec60-1e85-5c08-be19-0ac6f7c02853',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV63958',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 232902,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-10',
 'seller_name': None,
 'title': 'Opel Astra 1.4 SIDI Turbo Ultimate Start/Stop',
 'transmission': 'automatic',
 'trim': 'Ultimate Start/Stop',
 'year': 2019}
2026-03-29 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV63958%27 HTTP/1.1" 200 None
2026-03-29 10:48:40 [auto1.de] INFO: Saving data for ZV63958: {'auction_closing_time': 1774885048.0, 'created_time': 1774694445.189796, 'last_price_update_time': 1774781320.600139}
2026-03-29 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV63958') HTTP/1.1" 204 0
2026-03-29 10:48:40 [auto1.de] INFO: Channel: 24h | Page: 167 | totalHits: 6726 | hits on page: 40
2026-03-29 10:48:40 [auto1.de] INFO: Found listing with ID: VG24913
2026-03-29 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG24913%27 HTTP/1.1" 200 None
2026-03-29 10:48:40 [auto1.de] INFO: Scrape type for VG24913: 2
2026-03-29 10:48:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5428b46a-2f48-52d9-a2ad-7345de79f9fa with identifier: VG24913
2026-03-29 10:48:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5428b46a-2f48-52d9-a2ad-7345de79f9fa with scrape type 2
2026-03-29 10:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5428b46a-2f48-52d9-a2ad-7345de79f9fa with scrape type 2
2026-03-29 10:48:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5428b46a-2f48-52d9-a2ad-7345de79f9fa, identifier: VG24913
2026-03-29 10:48:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5428b46a-2f48-52d9-a2ad-7345de79f9fa with identifier: VG24913
2026-03-29 10:48:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5428b46a-2f48-52d9-a2ad-7345de79f9fa with identifier: VG24913
2026-03-29 10:48:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5428b46a-2f48-52d9-a2ad-7345de79f9fa with identifier: VG24913 to the API
2026-03-29 10:48:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:51:58Z',
 'fuel_type': 'petrol',
 'id': '5428b46a-2f48-52d9-a2ad-7345de79f9fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG24913',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 156286,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-28',
 'seller_name': None,
 'title': 'MINI Cabrio Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-29 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG24913%27 HTTP/1.1" 200 None
2026-03-29 10:48:41 [auto1.de] INFO: Saving data for VG24913: {'auction_closing_time': 1774885918.0, 'created_time': 1774349945.030406, 'last_price_update_time': 1774781321.00348}
2026-03-29 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG24913') HTTP/1.1" 204 0
2026-03-29 10:48:41 [auto1.de] INFO: Found listing with ID: UX99567
2026-03-29 10:48:41 [auto1.de] INFO: Found listing with ID: XD36777
2026-03-29 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD36777%27 HTTP/1.1" 200 None
2026-03-29 10:48:41 [auto1.de] INFO: Scrape type for XD36777: 2
2026-03-29 10:48:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b101f291-1c0a-5e60-be91-380369a5330b with identifier: XD36777
2026-03-29 10:48:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b101f291-1c0a-5e60-be91-380369a5330b with scrape type 2
2026-03-29 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b101f291-1c0a-5e60-be91-380369a5330b with scrape type 2
2026-03-29 10:48:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b101f291-1c0a-5e60-be91-380369a5330b, identifier: XD36777
2026-03-29 10:48:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:48:41 [auto1.de] INFO: Found listing with ID: XE04045
2026-03-29 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE04045%27 HTTP/1.1" 200 None
2026-03-29 10:48:41 [auto1.de] INFO: Scrape type for XE04045: 2
2026-03-29 10:48:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1de937e9-94f5-5079-903c-375c532e29a7 with identifier: XE04045
2026-03-29 10:48:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1de937e9-94f5-5079-903c-375c532e29a7 with scrape type 2
2026-03-29 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1de937e9-94f5-5079-903c-375c532e29a7 with scrape type 2
2026-03-29 10:48:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1de937e9-94f5-5079-903c-375c532e29a7, identifier: XE04045
2026-03-29 10:48:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b101f291-1c0a-5e60-be91-380369a5330b with identifier: XD36777
2026-03-29 10:48:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b101f291-1c0a-5e60-be91-380369a5330b with identifier: XD36777
2026-03-29 10:48:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b101f291-1c0a-5e60-be91-380369a5330b with identifier: XD36777 to the API
2026-03-29 10:48:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:33:41Z',
 'fuel_type': 'diesel',
 'id': 'b101f291-1c0a-5e60-be91-380369a5330b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD36777',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 169131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-07',
 'seller_name': None,
 'title': 'Opel Mokka 1.6 CDTI DPF Innovation ecoFlex',
 'transmission': 'manual',
 'trim': 'Innovation ecoFlex',
 'year': 2015}
2026-03-29 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD36777%27 HTTP/1.1" 200 None
2026-03-29 10:48:41 [auto1.de] INFO: Saving data for XD36777: {'auction_closing_time': 1774884821.0, 'created_time': 1774033316.388897, 'last_price_update_time': 1774781321.538944}
2026-03-29 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XD36777') HTTP/1.1" 204 0
2026-03-29 10:48:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1de937e9-94f5-5079-903c-375c532e29a7 with identifier: XE04045
2026-03-29 10:48:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1de937e9-94f5-5079-903c-375c532e29a7 with identifier: XE04045
2026-03-29 10:48:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1de937e9-94f5-5079-903c-375c532e29a7 with identifier: XE04045 to the API
2026-03-29 10:48:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:09:46Z',
 'fuel_type': 'diesel',
 'id': '1de937e9-94f5-5079-903c-375c532e29a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE04045',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 52865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-22',
 'seller_name': None,
 'title': 'BMW 1er 116d',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-29 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE04045%27 HTTP/1.1" 200 None
2026-03-29 10:48:41 [auto1.de] INFO: Saving data for XE04045: {'auction_closing_time': 1774883386.0, 'created_time': 1774035194.037889, 'last_price_update_time': 1774781321.938233}
2026-03-29 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE04045') HTTP/1.1" 204 0
2026-03-29 10:48:41 [auto1.de] INFO: Found listing with ID: PC48603
2026-03-29 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC48603%27 HTTP/1.1" 200 None
2026-03-29 10:48:41 [auto1.de] INFO: Scrape type for PC48603: 2
2026-03-29 10:48:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac61c536-0bdb-5c8f-887c-22e80ff00e6d with identifier: PC48603
2026-03-29 10:48:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac61c536-0bdb-5c8f-887c-22e80ff00e6d with scrape type 2
2026-03-29 10:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac61c536-0bdb-5c8f-887c-22e80ff00e6d with scrape type 2
2026-03-29 10:48:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac61c536-0bdb-5c8f-887c-22e80ff00e6d, identifier: PC48603
2026-03-29 10:48:42 [auto1.de] INFO: Found listing with ID: UV81203
2026-03-29 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV81203%27 HTTP/1.1" 200 None
2026-03-29 10:48:42 [auto1.de] INFO: Scrape type for UV81203: 2
2026-03-29 10:48:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d05342b4-f6e1-540a-8edb-c35bd6f65172 with identifier: UV81203
2026-03-29 10:48:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d05342b4-f6e1-540a-8edb-c35bd6f65172 with scrape type 2
2026-03-29 10:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d05342b4-f6e1-540a-8edb-c35bd6f65172 with scrape type 2
2026-03-29 10:48:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d05342b4-f6e1-540a-8edb-c35bd6f65172, identifier: UV81203
2026-03-29 10:48:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac61c536-0bdb-5c8f-887c-22e80ff00e6d with identifier: PC48603
2026-03-29 10:48:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac61c536-0bdb-5c8f-887c-22e80ff00e6d with identifier: PC48603
2026-03-29 10:48:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac61c536-0bdb-5c8f-887c-22e80ff00e6d with identifier: PC48603 to the API
2026-03-29 10:48:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:08:54Z',
 'fuel_type': 'diesel',
 'id': 'ac61c536-0bdb-5c8f-887c-22e80ff00e6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC48603',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 149435,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-11',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 250 d lang 4Matic BlueTEC',
 'transmission': 'automatic',
 'trim': 'lang 4Matic BlueTEC',
 'year': 2018}
2026-03-29 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC48603%27 HTTP/1.1" 200 None
2026-03-29 10:48:42 [auto1.de] INFO: Saving data for PC48603: {'auction_closing_time': 1774883334.0, 'created_time': 1773400760.502129, 'last_price_update_time': 1774781322.494046}
2026-03-29 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC48603') HTTP/1.1" 204 0
2026-03-29 10:48:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d05342b4-f6e1-540a-8edb-c35bd6f65172 with identifier: UV81203
2026-03-29 10:48:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d05342b4-f6e1-540a-8edb-c35bd6f65172 with identifier: UV81203
2026-03-29 10:48:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d05342b4-f6e1-540a-8edb-c35bd6f65172 with identifier: UV81203 to the API
2026-03-29 10:48:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:30:05Z',
 'fuel_type': 'petrol',
 'id': 'd05342b4-f6e1-540a-8edb-c35bd6f65172',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV81203',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 45685,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-09',
 'seller_name': None,
 'title': 'Fiat 500X 1.0 Turbo Google',
 'transmission': 'manual',
 'trim': 'Google',
 'year': 2021}
2026-03-29 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV81203%27 HTTP/1.1" 200 None
2026-03-29 10:48:42 [auto1.de] INFO: Saving data for UV81203: {'auction_closing_time': 1774884605.0, 'created_time': 1774035358.337396, 'last_price_update_time': 1774781322.816811}
2026-03-29 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UV81203') HTTP/1.1" 204 0
2026-03-29 10:48:42 [auto1.de] INFO: Found listing with ID: SR86923
2026-03-29 10:48:42 [auto1.de] INFO: Found listing with ID: GJ17699
2026-03-29 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ17699%27 HTTP/1.1" 200 None
2026-03-29 10:48:42 [auto1.de] INFO: Scrape type for GJ17699: 2
2026-03-29 10:48:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e129244-9817-5315-9826-0565b2e0ceec with identifier: GJ17699
2026-03-29 10:48:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e129244-9817-5315-9826-0565b2e0ceec with scrape type 2
2026-03-29 10:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e129244-9817-5315-9826-0565b2e0ceec with scrape type 2
2026-03-29 10:48:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e129244-9817-5315-9826-0565b2e0ceec, identifier: GJ17699
2026-03-29 10:48:42 [auto1.de] INFO: Found listing with ID: PU74458
2026-03-29 10:48:42 [auto1.de] INFO: Found listing with ID: NK23311
2026-03-29 10:48:42 [auto1.de] INFO: Found listing with ID: HP69948
2026-03-29 10:48:42 [auto1.de] INFO: Found listing with ID: FK48222
2026-03-29 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK48222%27 HTTP/1.1" 200 None
2026-03-29 10:48:42 [auto1.de] INFO: Scrape type for FK48222: 2
2026-03-29 10:48:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffabbdad-2c54-5a23-a7e4-b6497662fc7a with identifier: FK48222
2026-03-29 10:48:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffabbdad-2c54-5a23-a7e4-b6497662fc7a with scrape type 2
2026-03-29 10:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffabbdad-2c54-5a23-a7e4-b6497662fc7a with scrape type 2
2026-03-29 10:48:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ffabbdad-2c54-5a23-a7e4-b6497662fc7a, identifier: FK48222
2026-03-29 10:48:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e129244-9817-5315-9826-0565b2e0ceec with identifier: GJ17699
2026-03-29 10:48:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e129244-9817-5315-9826-0565b2e0ceec with identifier: GJ17699
2026-03-29 10:48:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e129244-9817-5315-9826-0565b2e0ceec with identifier: GJ17699 to the API
2026-03-29 10:48:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:29:22Z',
 'fuel_type': 'petrol',
 'id': '0e129244-9817-5315-9826-0565b2e0ceec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ17699',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 160379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-06',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2011}
2026-03-29 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ17699%27 HTTP/1.1" 200 None
2026-03-29 10:48:43 [auto1.de] INFO: Saving data for GJ17699: {'auction_closing_time': 1774884562.0, 'created_time': 1774001906.450448, 'last_price_update_time': 1774781323.369446}
2026-03-29 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ17699') HTTP/1.1" 204 0
2026-03-29 10:48:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ffabbdad-2c54-5a23-a7e4-b6497662fc7a with identifier: FK48222
2026-03-29 10:48:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ffabbdad-2c54-5a23-a7e4-b6497662fc7a with identifier: FK48222
2026-03-29 10:48:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ffabbdad-2c54-5a23-a7e4-b6497662fc7a with identifier: FK48222 to the API
2026-03-29 10:48:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:31:52Z',
 'fuel_type': 'petrol',
 'id': 'ffabbdad-2c54-5a23-a7e4-b6497662fc7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK48222',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 10891,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-16',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2024}
2026-03-29 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK48222%27 HTTP/1.1" 200 None
2026-03-29 10:48:43 [auto1.de] INFO: Saving data for FK48222: {'auction_closing_time': 1774884712.0, 'created_time': 1773399974.619575, 'last_price_update_time': 1774781323.668108}
2026-03-29 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK48222') HTTP/1.1" 204 0
2026-03-29 10:48:43 [auto1.de] INFO: Found listing with ID: ZX68256
2026-03-29 10:48:43 [auto1.de] INFO: Found listing with ID: HF47476
2026-03-29 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF47476%27 HTTP/1.1" 200 None
2026-03-29 10:48:43 [auto1.de] INFO: Scrape type for HF47476: 2
2026-03-29 10:48:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26f18a9a-9790-5f6a-bd69-3ef53bf8661e with identifier: HF47476
2026-03-29 10:48:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26f18a9a-9790-5f6a-bd69-3ef53bf8661e with scrape type 2
2026-03-29 10:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26f18a9a-9790-5f6a-bd69-3ef53bf8661e with scrape type 2
2026-03-29 10:48:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 26f18a9a-9790-5f6a-bd69-3ef53bf8661e, identifier: HF47476
2026-03-29 10:48:43 [auto1.de] INFO: Found listing with ID: KE90826
2026-03-29 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE90826%27 HTTP/1.1" 200 None
2026-03-29 10:48:43 [auto1.de] INFO: Scrape type for KE90826: 2
2026-03-29 10:48:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09edb6e8-1b98-5bbd-9f63-4555ecf2639a with identifier: KE90826
2026-03-29 10:48:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09edb6e8-1b98-5bbd-9f63-4555ecf2639a with scrape type 2
2026-03-29 10:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09edb6e8-1b98-5bbd-9f63-4555ecf2639a with scrape type 2
2026-03-29 10:48:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 09edb6e8-1b98-5bbd-9f63-4555ecf2639a, identifier: KE90826
2026-03-29 10:48:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 26f18a9a-9790-5f6a-bd69-3ef53bf8661e with identifier: HF47476
2026-03-29 10:48:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 26f18a9a-9790-5f6a-bd69-3ef53bf8661e with identifier: HF47476
2026-03-29 10:48:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 26f18a9a-9790-5f6a-bd69-3ef53bf8661e with identifier: HF47476 to the API
2026-03-29 10:48:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:34:45Z',
 'fuel_type': 'petrol',
 'id': '26f18a9a-9790-5f6a-bd69-3ef53bf8661e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF47476',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 44511,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-20',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18i M Sport',
 'transmission': 'manual',
 'trim': 'M Sport',
 'year': 2019}
2026-03-29 10:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF47476%27 HTTP/1.1" 200 None
2026-03-29 10:48:44 [auto1.de] INFO: Saving data for HF47476: {'auction_closing_time': 1774884885.0, 'created_time': 1774031756.380528, 'last_price_update_time': 1774781324.209398}
2026-03-29 10:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HF47476') HTTP/1.1" 204 0
2026-03-29 10:48:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 09edb6e8-1b98-5bbd-9f63-4555ecf2639a with identifier: KE90826
2026-03-29 10:48:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 09edb6e8-1b98-5bbd-9f63-4555ecf2639a with identifier: KE90826
2026-03-29 10:48:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 09edb6e8-1b98-5bbd-9f63-4555ecf2639a with identifier: KE90826 to the API
2026-03-29 10:48:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:34:57Z',
 'fuel_type': 'petrol',
 'id': '09edb6e8-1b98-5bbd-9f63-4555ecf2639a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE90826',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 115776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-15',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-29 10:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE90826%27 HTTP/1.1" 200 None
2026-03-29 10:48:44 [auto1.de] INFO: Saving data for KE90826: {'auction_closing_time': 1774884897.0, 'created_time': 1773427918.145951, 'last_price_update_time': 1774781324.615047}
2026-03-29 10:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE90826') HTTP/1.1" 204 0
2026-03-29 10:48:44 [auto1.de] INFO: Found listing with ID: CZ39134
2026-03-29 10:48:44 [auto1.de] INFO: Found listing with ID: EU15499
2026-03-29 10:48:44 [auto1.de] INFO: Found listing with ID: DC48276
2026-03-29 10:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC48276%27 HTTP/1.1" 200 None
2026-03-29 10:48:44 [auto1.de] INFO: Scrape type for DC48276: 2
2026-03-29 10:48:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81662b1e-9d4b-5d62-8598-92415cfbd56d with identifier: DC48276
2026-03-29 10:48:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81662b1e-9d4b-5d62-8598-92415cfbd56d with scrape type 2
2026-03-29 10:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81662b1e-9d4b-5d62-8598-92415cfbd56d with scrape type 2
2026-03-29 10:48:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81662b1e-9d4b-5d62-8598-92415cfbd56d, identifier: DC48276
2026-03-29 10:48:44 [auto1.de] INFO: Found listing with ID: MN93715
2026-03-29 10:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN93715%27 HTTP/1.1" 200 None
2026-03-29 10:48:44 [auto1.de] INFO: Scrape type for MN93715: 2
2026-03-29 10:48:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58e72cac-eb60-5a58-bffe-dd9676629371 with identifier: MN93715
2026-03-29 10:48:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58e72cac-eb60-5a58-bffe-dd9676629371 with scrape type 2
2026-03-29 10:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58e72cac-eb60-5a58-bffe-dd9676629371 with scrape type 2
2026-03-29 10:48:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58e72cac-eb60-5a58-bffe-dd9676629371, identifier: MN93715
2026-03-29 10:48:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81662b1e-9d4b-5d62-8598-92415cfbd56d with identifier: DC48276
2026-03-29 10:48:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81662b1e-9d4b-5d62-8598-92415cfbd56d with identifier: DC48276
2026-03-29 10:48:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81662b1e-9d4b-5d62-8598-92415cfbd56d with identifier: DC48276 to the API
2026-03-29 10:48:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 182,
 'expiration_date': '2026-03-30T15:04:25Z',
 'fuel_type': 'petrol',
 'id': '81662b1e-9d4b-5d62-8598-92415cfbd56d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC48276',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 145832,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-21',
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 EcoBoost ST',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2014}
2026-03-29 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC48276%27 HTTP/1.1" 200 None
2026-03-29 10:48:45 [auto1.de] INFO: Saving data for DC48276: {'auction_closing_time': 1774883065.0, 'created_time': 1774034501.398481, 'last_price_update_time': 1774781325.137035}
2026-03-29 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DC48276') HTTP/1.1" 204 0
2026-03-29 10:48:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58e72cac-eb60-5a58-bffe-dd9676629371 with identifier: MN93715
2026-03-29 10:48:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58e72cac-eb60-5a58-bffe-dd9676629371 with identifier: MN93715
2026-03-29 10:48:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58e72cac-eb60-5a58-bffe-dd9676629371 with identifier: MN93715 to the API
2026-03-29 10:48:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:47:34Z',
 'fuel_type': 'diesel',
 'id': '58e72cac-eb60-5a58-bffe-dd9676629371',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN93715',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 185055,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-04-22',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.9 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2004}
2026-03-29 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN93715%27 HTTP/1.1" 200 None
2026-03-29 10:48:45 [auto1.de] INFO: Saving data for MN93715: {'auction_closing_time': 1774885654.0, 'created_time': 1774002029.850646, 'last_price_update_time': 1774781325.434056}
2026-03-29 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN93715') HTTP/1.1" 204 0
2026-03-29 10:48:45 [auto1.de] INFO: Found listing with ID: HG48100
2026-03-29 10:48:45 [auto1.de] INFO: Found listing with ID: DS20438
2026-03-29 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS20438%27 HTTP/1.1" 200 None
2026-03-29 10:48:45 [auto1.de] INFO: Scrape type for DS20438: 2
2026-03-29 10:48:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fb7c6e4-e8ba-5bef-9bce-e52199708f93 with identifier: DS20438
2026-03-29 10:48:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fb7c6e4-e8ba-5bef-9bce-e52199708f93 with scrape type 2
2026-03-29 10:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fb7c6e4-e8ba-5bef-9bce-e52199708f93 with scrape type 2
2026-03-29 10:48:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0fb7c6e4-e8ba-5bef-9bce-e52199708f93, identifier: DS20438
2026-03-29 10:48:45 [auto1.de] INFO: Found listing with ID: YJ19312
2026-03-29 10:48:45 [auto1.de] INFO: Found listing with ID: BS68769
2026-03-29 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS68769%27 HTTP/1.1" 200 None
2026-03-29 10:48:45 [auto1.de] INFO: Scrape type for BS68769: 2
2026-03-29 10:48:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6330493b-dc11-593e-a743-a21e30b057eb with identifier: BS68769
2026-03-29 10:48:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6330493b-dc11-593e-a743-a21e30b057eb with scrape type 2
2026-03-29 10:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6330493b-dc11-593e-a743-a21e30b057eb with scrape type 2
2026-03-29 10:48:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6330493b-dc11-593e-a743-a21e30b057eb, identifier: BS68769
2026-03-29 10:48:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0fb7c6e4-e8ba-5bef-9bce-e52199708f93 with identifier: DS20438
2026-03-29 10:48:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0fb7c6e4-e8ba-5bef-9bce-e52199708f93 with identifier: DS20438
2026-03-29 10:48:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0fb7c6e4-e8ba-5bef-9bce-e52199708f93 with identifier: DS20438 to the API
2026-03-29 10:48:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:38:21Z',
 'fuel_type': 'diesel',
 'id': '0fb7c6e4-e8ba-5bef-9bce-e52199708f93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS20438',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 109205,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-05',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-29 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS20438%27 HTTP/1.1" 200 None
2026-03-29 10:48:45 [auto1.de] INFO: Saving data for DS20438: {'auction_closing_time': 1774885101.0, 'created_time': 1774694446.294124, 'last_price_update_time': 1774781325.977582}
2026-03-29 10:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DS20438') HTTP/1.1" 204 0
2026-03-29 10:48:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6330493b-dc11-593e-a743-a21e30b057eb with identifier: BS68769
2026-03-29 10:48:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6330493b-dc11-593e-a743-a21e30b057eb with identifier: BS68769
2026-03-29 10:48:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6330493b-dc11-593e-a743-a21e30b057eb with identifier: BS68769 to the API
2026-03-29 10:48:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:21:22Z',
 'fuel_type': 'petrol',
 'id': '6330493b-dc11-593e-a743-a21e30b057eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS68769',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 132074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-26',
 'seller_name': None,
 'title': 'Skoda Yeti 1.2 TSI Ambition Plus Edition',
 'transmission': 'automatic',
 'trim': 'Ambition Plus Edition',
 'year': 2012}
2026-03-29 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS68769%27 HTTP/1.1" 200 None
2026-03-29 10:48:46 [auto1.de] INFO: Saving data for BS68769: {'auction_closing_time': 1774884082.0, 'created_time': 1774032332.002269, 'last_price_update_time': 1774781326.299576}
2026-03-29 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS68769') HTTP/1.1" 204 0
2026-03-29 10:48:46 [auto1.de] INFO: Found listing with ID: CC34542
2026-03-29 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC34542%27 HTTP/1.1" 200 None
2026-03-29 10:48:46 [auto1.de] INFO: Scrape type for CC34542: 2
2026-03-29 10:48:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9871451f-a45a-59fa-bfe7-33f472c897af with identifier: CC34542
2026-03-29 10:48:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9871451f-a45a-59fa-bfe7-33f472c897af with scrape type 2
2026-03-29 10:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9871451f-a45a-59fa-bfe7-33f472c897af with scrape type 2
2026-03-29 10:48:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9871451f-a45a-59fa-bfe7-33f472c897af, identifier: CC34542
2026-03-29 10:48:46 [auto1.de] INFO: Found listing with ID: LJ34502
2026-03-29 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ34502%27 HTTP/1.1" 200 None
2026-03-29 10:48:46 [auto1.de] INFO: Scrape type for LJ34502: 0
2026-03-29 10:48:46 [auto1.de] INFO: Found listing with ID: NE48651
2026-03-29 10:48:46 [auto1.de] INFO: Found listing with ID: TJ68834
2026-03-29 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ68834%27 HTTP/1.1" 200 None
2026-03-29 10:48:46 [auto1.de] INFO: Scrape type for TJ68834: 2
2026-03-29 10:48:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a01dfb3-7862-56ba-9ef0-29eafcd2b52c with identifier: TJ68834
2026-03-29 10:48:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a01dfb3-7862-56ba-9ef0-29eafcd2b52c with scrape type 2
2026-03-29 10:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a01dfb3-7862-56ba-9ef0-29eafcd2b52c with scrape type 2
2026-03-29 10:48:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a01dfb3-7862-56ba-9ef0-29eafcd2b52c, identifier: TJ68834
2026-03-29 10:48:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9871451f-a45a-59fa-bfe7-33f472c897af with identifier: CC34542
2026-03-29 10:48:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9871451f-a45a-59fa-bfe7-33f472c897af with identifier: CC34542
2026-03-29 10:48:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9871451f-a45a-59fa-bfe7-33f472c897af with identifier: CC34542 to the API
2026-03-29 10:48:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:00:20Z',
 'fuel_type': 'petrol',
 'id': '9871451f-a45a-59fa-bfe7-33f472c897af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC34542',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 218384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-30',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 Tour',
 'transmission': 'manual',
 'trim': 'Tour',
 'year': 2009}
2026-03-29 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC34542%27 HTTP/1.1" 200 None
2026-03-29 10:48:46 [auto1.de] INFO: Saving data for CC34542: {'auction_closing_time': 1774882820.0, 'created_time': 1774350510.409861, 'last_price_update_time': 1774781326.850959}
2026-03-29 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC34542') HTTP/1.1" 204 0
2026-03-29 10:48:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a01dfb3-7862-56ba-9ef0-29eafcd2b52c with identifier: TJ68834
2026-03-29 10:48:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a01dfb3-7862-56ba-9ef0-29eafcd2b52c with identifier: TJ68834
2026-03-29 10:48:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a01dfb3-7862-56ba-9ef0-29eafcd2b52c with identifier: TJ68834 to the API
2026-03-29 10:48:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:44:01Z',
 'fuel_type': 'petrol',
 'id': '6a01dfb3-7862-56ba-9ef0-29eafcd2b52c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ68834',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 116201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-22',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-29 10:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ68834%27 HTTP/1.1" 200 None
2026-03-29 10:48:48 [auto1.de] INFO: Saving data for TJ68834: {'auction_closing_time': 1774885441.0, 'created_time': 1773380119.157368, 'last_price_update_time': 1774781328.784521}
2026-03-29 10:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ68834') HTTP/1.1" 204 0
2026-03-29 10:48:48 [auto1.de] INFO: Found listing with ID: WA68058
2026-03-29 10:48:48 [auto1.de] INFO: Found listing with ID: RZ05971
2026-03-29 10:48:48 [auto1.de] INFO: Found listing with ID: WC61131
2026-03-29 10:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC61131%27 HTTP/1.1" 200 None
2026-03-29 10:48:48 [auto1.de] INFO: Scrape type for WC61131: 2
2026-03-29 10:48:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 667bb6bd-3af4-560e-a58e-5af0ed8f57f9 with identifier: WC61131
2026-03-29 10:48:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 667bb6bd-3af4-560e-a58e-5af0ed8f57f9 with scrape type 2
2026-03-29 10:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 667bb6bd-3af4-560e-a58e-5af0ed8f57f9 with scrape type 2
2026-03-29 10:48:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 667bb6bd-3af4-560e-a58e-5af0ed8f57f9, identifier: WC61131
2026-03-29 10:48:48 [auto1.de] INFO: Found listing with ID: BA78869
2026-03-29 10:48:48 [auto1.de] INFO: Found listing with ID: NG50641
2026-03-29 10:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG50641%27 HTTP/1.1" 200 None
2026-03-29 10:48:48 [auto1.de] INFO: Scrape type for NG50641: 2
2026-03-29 10:48:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7 with identifier: NG50641
2026-03-29 10:48:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7 with scrape type 2
2026-03-29 10:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7 with scrape type 2
2026-03-29 10:48:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7, identifier: NG50641
2026-03-29 10:48:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 667bb6bd-3af4-560e-a58e-5af0ed8f57f9 with identifier: WC61131
2026-03-29 10:48:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 667bb6bd-3af4-560e-a58e-5af0ed8f57f9 with identifier: WC61131
2026-03-29 10:48:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 667bb6bd-3af4-560e-a58e-5af0ed8f57f9 with identifier: WC61131 to the API
2026-03-29 10:48:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:26:28Z',
 'fuel_type': 'diesel',
 'id': '667bb6bd-3af4-560e-a58e-5af0ed8f57f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC61131',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 347285,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-27',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Attraction',
 'transmission': 'automatic',
 'trim': 'Attraction',
 'year': 2011}
2026-03-29 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC61131%27 HTTP/1.1" 200 None
2026-03-29 10:48:49 [auto1.de] INFO: Saving data for WC61131: {'auction_closing_time': 1774884388.0, 'created_time': 1773946513.615865, 'last_price_update_time': 1774781329.317254}
2026-03-29 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC61131') HTTP/1.1" 204 0
2026-03-29 10:48:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7 with identifier: NG50641
2026-03-29 10:48:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7 with identifier: NG50641
2026-03-29 10:48:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7 with identifier: NG50641 to the API
2026-03-29 10:48:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:57:08Z',
 'fuel_type': 'diesel',
 'id': 'c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG50641',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 238404,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-17',
 'seller_name': None,
 'title': 'Audi A5 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2008}
2026-03-29 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG50641%27 HTTP/1.1" 200 None
2026-03-29 10:48:49 [auto1.de] INFO: Saving data for NG50641: {'auction_closing_time': 1774886228.0, 'created_time': 1774694454.469318, 'last_price_update_time': 1774781329.599231}
2026-03-29 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG50641') HTTP/1.1" 204 0
2026-03-29 10:48:49 [auto1.de] INFO: Found listing with ID: RU40839
2026-03-29 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU40839%27 HTTP/1.1" 200 None
2026-03-29 10:48:49 [auto1.de] INFO: Scrape type for RU40839: 2
2026-03-29 10:48:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ab06a83-ca1b-5684-abdd-5a53f38de1ea with identifier: RU40839
2026-03-29 10:48:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ab06a83-ca1b-5684-abdd-5a53f38de1ea with scrape type 2
2026-03-29 10:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ab06a83-ca1b-5684-abdd-5a53f38de1ea with scrape type 2
2026-03-29 10:48:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ab06a83-ca1b-5684-abdd-5a53f38de1ea, identifier: RU40839
2026-03-29 10:48:49 [auto1.de] INFO: Found listing with ID: DJ78015
2026-03-29 10:48:49 [auto1.de] INFO: Found listing with ID: SM71650
2026-03-29 10:48:49 [auto1.de] INFO: Found listing with ID: BA31995
2026-03-29 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA31995%27 HTTP/1.1" 200 None
2026-03-29 10:48:49 [auto1.de] INFO: Scrape type for BA31995: 2
2026-03-29 10:48:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10b04593-3a41-523b-9bb5-29a46f0ed0c7 with identifier: BA31995
2026-03-29 10:48:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10b04593-3a41-523b-9bb5-29a46f0ed0c7 with scrape type 2
2026-03-29 10:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10b04593-3a41-523b-9bb5-29a46f0ed0c7 with scrape type 2
2026-03-29 10:48:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10b04593-3a41-523b-9bb5-29a46f0ed0c7, identifier: BA31995
2026-03-29 10:48:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ab06a83-ca1b-5684-abdd-5a53f38de1ea with identifier: RU40839
2026-03-29 10:48:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ab06a83-ca1b-5684-abdd-5a53f38de1ea with identifier: RU40839
2026-03-29 10:48:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ab06a83-ca1b-5684-abdd-5a53f38de1ea with identifier: RU40839 to the API
2026-03-29 10:48:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 349,
 'expiration_date': '2026-03-30T15:16:19Z',
 'fuel_type': 'diesel',
 'id': '4ab06a83-ca1b-5684-abdd-5a53f38de1ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU40839',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6 Allroad',
 'odometer': 127133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-08',
 'seller_name': None,
 'title': 'Audi A6 Allroad 55 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2020}
2026-03-29 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU40839%27 HTTP/1.1" 200 None
2026-03-29 10:48:50 [auto1.de] INFO: Saving data for RU40839: {'auction_closing_time': 1774883779.0, 'created_time': 1774694442.747279, 'last_price_update_time': 1774781330.124467}
2026-03-29 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU40839') HTTP/1.1" 204 0
2026-03-29 10:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:48:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10b04593-3a41-523b-9bb5-29a46f0ed0c7 with identifier: BA31995
2026-03-29 10:48:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10b04593-3a41-523b-9bb5-29a46f0ed0c7 with identifier: BA31995
2026-03-29 10:48:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10b04593-3a41-523b-9bb5-29a46f0ed0c7 with identifier: BA31995 to the API
2026-03-29 10:48:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:48:51Z',
 'fuel_type': 'diesel',
 'id': '10b04593-3a41-523b-9bb5-29a46f0ed0c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA31995',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 119867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-07',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-29 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA31995%27 HTTP/1.1" 200 None
2026-03-29 10:48:50 [auto1.de] INFO: Saving data for BA31995: {'auction_closing_time': 1774885731.0, 'created_time': 1774033863.169293, 'last_price_update_time': 1774781330.406671}
2026-03-29 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BA31995') HTTP/1.1" 204 0
2026-03-29 10:48:50 [auto1.de] INFO: Found listing with ID: VL73605
2026-03-29 10:48:50 [auto1.de] INFO: Found listing with ID: TZ58013
2026-03-29 10:48:50 [auto1.de] INFO: Found listing with ID: BC10414
2026-03-29 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC10414%27 HTTP/1.1" 200 None
2026-03-29 10:48:50 [auto1.de] INFO: Scrape type for BC10414: 2
2026-03-29 10:48:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2207154b-a38d-53d6-b607-c1eeff60122b with identifier: BC10414
2026-03-29 10:48:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2207154b-a38d-53d6-b607-c1eeff60122b with scrape type 2
2026-03-29 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2207154b-a38d-53d6-b607-c1eeff60122b with scrape type 2
2026-03-29 10:48:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2207154b-a38d-53d6-b607-c1eeff60122b, identifier: BC10414
2026-03-29 10:48:50 [auto1.de] INFO: Found listing with ID: ZU52934
2026-03-29 10:48:50 [auto1.de] INFO: Found listing with ID: PW89679
2026-03-29 10:48:50 [auto1.de] INFO: Found listing with ID: GD61279
2026-03-29 10:48:50 [auto1.de] INFO: Found listing with ID: PF87793
2026-03-29 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF87793%27 HTTP/1.1" 200 None
2026-03-29 10:48:50 [auto1.de] INFO: Scrape type for PF87793: 2
2026-03-29 10:48:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e22417b4-4de5-5e59-bd1d-314801102de4 with identifier: PF87793
2026-03-29 10:48:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e22417b4-4de5-5e59-bd1d-314801102de4 with scrape type 2
2026-03-29 10:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e22417b4-4de5-5e59-bd1d-314801102de4 with scrape type 2
2026-03-29 10:48:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e22417b4-4de5-5e59-bd1d-314801102de4, identifier: PF87793
2026-03-29 10:48:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2207154b-a38d-53d6-b607-c1eeff60122b with identifier: BC10414
2026-03-29 10:48:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2207154b-a38d-53d6-b607-c1eeff60122b with identifier: BC10414
2026-03-29 10:48:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2207154b-a38d-53d6-b607-c1eeff60122b with identifier: BC10414 to the API
2026-03-29 10:48:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:32:36Z',
 'fuel_type': 'petrol',
 'id': '2207154b-a38d-53d6-b607-c1eeff60122b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC10414',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 150082,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-07',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.2 TSI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2010}
2026-03-29 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC10414%27 HTTP/1.1" 200 None
2026-03-29 10:48:50 [auto1.de] INFO: Saving data for BC10414: {'auction_closing_time': 1774884756.0, 'created_time': 1774118564.704608, 'last_price_update_time': 1774781330.908159}
2026-03-29 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BC10414') HTTP/1.1" 204 0
2026-03-29 10:48:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e22417b4-4de5-5e59-bd1d-314801102de4 with identifier: PF87793
2026-03-29 10:48:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e22417b4-4de5-5e59-bd1d-314801102de4 with identifier: PF87793
2026-03-29 10:48:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e22417b4-4de5-5e59-bd1d-314801102de4 with identifier: PF87793 to the API
2026-03-29 10:48:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-30T15:16:46Z',
 'fuel_type': 'petrol',
 'id': 'e22417b4-4de5-5e59-bd1d-314801102de4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF87793',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 56599,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-20',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2018}
2026-03-29 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF87793%27 HTTP/1.1" 200 None
2026-03-29 10:48:51 [auto1.de] INFO: Saving data for PF87793: {'auction_closing_time': 1774883806.0, 'created_time': 1773382809.711778, 'last_price_update_time': 1774781331.342215}
2026-03-29 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PF87793') HTTP/1.1" 204 0
2026-03-29 10:48:51 [auto1.de] INFO: Found listing with ID: LG96250
2026-03-29 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG96250%27 HTTP/1.1" 200 None
2026-03-29 10:48:51 [auto1.de] INFO: Scrape type for LG96250: 2
2026-03-29 10:48:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0 with identifier: LG96250
2026-03-29 10:48:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0 with scrape type 2
2026-03-29 10:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0 with scrape type 2
2026-03-29 10:48:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0, identifier: LG96250
2026-03-29 10:48:51 [auto1.de] INFO: Found listing with ID: KU32415
2026-03-29 10:48:51 [auto1.de] INFO: Found listing with ID: RR24690
2026-03-29 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR24690%27 HTTP/1.1" 200 None
2026-03-29 10:48:51 [auto1.de] INFO: Scrape type for RR24690: 2
2026-03-29 10:48:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03fc03a0-6612-5e95-9f7b-af39c676baea with identifier: RR24690
2026-03-29 10:48:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03fc03a0-6612-5e95-9f7b-af39c676baea with scrape type 2
2026-03-29 10:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03fc03a0-6612-5e95-9f7b-af39c676baea with scrape type 2
2026-03-29 10:48:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03fc03a0-6612-5e95-9f7b-af39c676baea, identifier: RR24690
2026-03-29 10:48:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0 with identifier: LG96250
2026-03-29 10:48:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0 with identifier: LG96250
2026-03-29 10:48:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0 with identifier: LG96250 to the API
2026-03-29 10:48:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:54:03Z',
 'fuel_type': 'diesel',
 'id': '33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG96250',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 41206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-04-06',
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 320 L1 Trend',
 'transmission': 'manual',
 'trim': '320 L1 Trend',
 'year': 2020}
2026-03-29 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG96250%27 HTTP/1.1" 200 None
2026-03-29 10:48:51 [auto1.de] INFO: Saving data for LG96250: {'auction_closing_time': 1774886043.0, 'created_time': 1774694452.400891, 'last_price_update_time': 1774781331.891006}
2026-03-29 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG96250') HTTP/1.1" 204 0
2026-03-29 10:48:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03fc03a0-6612-5e95-9f7b-af39c676baea with identifier: RR24690
2026-03-29 10:48:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03fc03a0-6612-5e95-9f7b-af39c676baea with identifier: RR24690
2026-03-29 10:48:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03fc03a0-6612-5e95-9f7b-af39c676baea with identifier: RR24690 to the API
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:00:52Z',
 'fuel_type': 'petrol',
 'id': '03fc03a0-6612-5e95-9f7b-af39c676baea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR24690',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 56992,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-12-05',
 'seller_name': None,
 'title': 'Opel Meriva 1.8 Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2004}
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR24690%27 HTTP/1.1" 200 None
2026-03-29 10:48:52 [auto1.de] INFO: Saving data for RR24690: {'auction_closing_time': 1774882852.0, 'created_time': 1774034185.748281, 'last_price_update_time': 1774781332.192537}
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RR24690') HTTP/1.1" 204 0
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: MG73872
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: SB27489
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB27489%27 HTTP/1.1" 200 None
2026-03-29 10:48:52 [auto1.de] INFO: Scrape type for SB27489: 2
2026-03-29 10:48:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87524815-4ab9-5a57-802c-eb2415c14cb2 with identifier: SB27489
2026-03-29 10:48:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87524815-4ab9-5a57-802c-eb2415c14cb2 with scrape type 2
2026-03-29 10:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87524815-4ab9-5a57-802c-eb2415c14cb2 with scrape type 2
2026-03-29 10:48:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87524815-4ab9-5a57-802c-eb2415c14cb2, identifier: SB27489
2026-03-29 10:48:52 [auto1.de] INFO: Channel: 24h | Page: 168 | totalHits: 6726 | hits on page: 40
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: NG84191
2026-03-29 10:48:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87524815-4ab9-5a57-802c-eb2415c14cb2 with identifier: SB27489
2026-03-29 10:48:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87524815-4ab9-5a57-802c-eb2415c14cb2 with identifier: SB27489
2026-03-29 10:48:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87524815-4ab9-5a57-802c-eb2415c14cb2 with identifier: SB27489 to the API
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:54:50Z',
 'fuel_type': 'petrol',
 'id': '87524815-4ab9-5a57-802c-eb2415c14cb2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB27489',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 57395,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-13',
 'seller_name': None,
 'title': 'Ford C-Max 1.5 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2019}
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB27489%27 HTTP/1.1" 200 None
2026-03-29 10:48:52 [auto1.de] INFO: Saving data for SB27489: {'auction_closing_time': 1774886090.0, 'created_time': 1774031770.609876, 'last_price_update_time': 1774781332.605664}
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SB27489') HTTP/1.1" 204 0
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: RM35826
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: EH57829
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: GR42785
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: FG97894
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG97894%27 HTTP/1.1" 200 None
2026-03-29 10:48:52 [auto1.de] INFO: Scrape type for FG97894: 2
2026-03-29 10:48:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8008ee99-275f-5bbc-8401-d8f522dd13c1 with identifier: FG97894
2026-03-29 10:48:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8008ee99-275f-5bbc-8401-d8f522dd13c1 with scrape type 2
2026-03-29 10:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8008ee99-275f-5bbc-8401-d8f522dd13c1 with scrape type 2
2026-03-29 10:48:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8008ee99-275f-5bbc-8401-d8f522dd13c1, identifier: FG97894
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: NH74932
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH74932%27 HTTP/1.1" 200 None
2026-03-29 10:48:52 [auto1.de] INFO: Scrape type for NH74932: 0
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: WA60872
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: PC86018
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC86018%27 HTTP/1.1" 200 None
2026-03-29 10:48:52 [auto1.de] INFO: Scrape type for PC86018: 0
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: RJ17594
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: EE70645
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE70645%27 HTTP/1.1" 200 None
2026-03-29 10:48:52 [auto1.de] INFO: Scrape type for EE70645: 0
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: WC98530
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: ET93890
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: DV01854
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: UE23148
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: GV87257
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV87257%27 HTTP/1.1" 200 None
2026-03-29 10:48:52 [auto1.de] INFO: Scrape type for GV87257: 0
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: DW63947
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW63947%27 HTTP/1.1" 200 None
2026-03-29 10:48:52 [auto1.de] INFO: Scrape type for DW63947: 0
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: MR80797
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR80797%27 HTTP/1.1" 200 None
2026-03-29 10:48:52 [auto1.de] INFO: Scrape type for MR80797: 0
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: JG09776
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG09776%27 HTTP/1.1" 200 None
2026-03-29 10:48:52 [auto1.de] INFO: Scrape type for JG09776: 0
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: KN89851
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN89851%27 HTTP/1.1" 200 None
2026-03-29 10:48:52 [auto1.de] INFO: Scrape type for KN89851: 0
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: ZS91776
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: VX64192
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: SN59057
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN59057%27 HTTP/1.1" 200 None
2026-03-29 10:48:52 [auto1.de] INFO: Scrape type for SN59057: 0
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: HN30713
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN30713%27 HTTP/1.1" 200 None
2026-03-29 10:48:52 [auto1.de] INFO: Scrape type for HN30713: 0
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: HX26034
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX26034%27 HTTP/1.1" 200 None
2026-03-29 10:48:52 [auto1.de] INFO: Scrape type for HX26034: 0
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: JM84539
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM84539%27 HTTP/1.1" 200 None
2026-03-29 10:48:52 [auto1.de] INFO: Scrape type for JM84539: 0
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: ED17592
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: FX10664
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: YS85041
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: SA72016
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA72016%27 HTTP/1.1" 200 None
2026-03-29 10:48:52 [auto1.de] INFO: Scrape type for SA72016: 0
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: WG54603
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: VV82390
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: SK64465
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: GY99851
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: KG73349
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: NR46432
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR46432%27 HTTP/1.1" 200 None
2026-03-29 10:48:52 [auto1.de] INFO: Scrape type for NR46432: 0
2026-03-29 10:48:52 [auto1.de] INFO: Found listing with ID: GD21382
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD21382%27 HTTP/1.1" 200 None
2026-03-29 10:48:52 [auto1.de] INFO: Scrape type for GD21382: 2
2026-03-29 10:48:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53a9a771-8248-5b29-b7ae-fb13f9177d58 with identifier: GD21382
2026-03-29 10:48:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53a9a771-8248-5b29-b7ae-fb13f9177d58 with scrape type 2
2026-03-29 10:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53a9a771-8248-5b29-b7ae-fb13f9177d58 with scrape type 2
2026-03-29 10:48:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 53a9a771-8248-5b29-b7ae-fb13f9177d58, identifier: GD21382
2026-03-29 10:48:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8008ee99-275f-5bbc-8401-d8f522dd13c1 with identifier: FG97894
2026-03-29 10:48:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8008ee99-275f-5bbc-8401-d8f522dd13c1 with identifier: FG97894
2026-03-29 10:48:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8008ee99-275f-5bbc-8401-d8f522dd13c1 with identifier: FG97894 to the API
2026-03-29 10:48:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:55:04Z',
 'fuel_type': 'petrol',
 'id': '8008ee99-275f-5bbc-8401-d8f522dd13c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG97894',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 60713,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-07',
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 DualJet Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2018}
2026-03-29 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG97894%27 HTTP/1.1" 200 None
2026-03-29 10:48:53 [auto1.de] INFO: Saving data for FG97894: {'auction_closing_time': 1774886104.0, 'created_time': 1773341077.602483, 'last_price_update_time': 1774781333.428963}
2026-03-29 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG97894') HTTP/1.1" 204 0
2026-03-29 10:48:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 53a9a771-8248-5b29-b7ae-fb13f9177d58 with identifier: GD21382
2026-03-29 10:48:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 53a9a771-8248-5b29-b7ae-fb13f9177d58 with identifier: GD21382
2026-03-29 10:48:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 53a9a771-8248-5b29-b7ae-fb13f9177d58 with identifier: GD21382 to the API
2026-03-29 10:48:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:31:54Z',
 'fuel_type': 'diesel',
 'id': '53a9a771-8248-5b29-b7ae-fb13f9177d58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD21382',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 454600,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-12',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2011}
2026-03-29 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD21382%27 HTTP/1.1" 200 None
2026-03-29 10:48:53 [auto1.de] INFO: Saving data for GD21382: {'auction_closing_time': 1774884714.0, 'created_time': 1774263760.259523, 'last_price_update_time': 1774781333.856938}
2026-03-29 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD21382') HTTP/1.1" 204 0
2026-03-29 10:48:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:48:53 [auto1.de] INFO: Found listing with ID: MM73538
2026-03-29 10:48:53 [auto1.de] INFO: Found listing with ID: PX49171
2026-03-29 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX49171%27 HTTP/1.1" 200 None
2026-03-29 10:48:53 [auto1.de] INFO: Scrape type for PX49171: 2
2026-03-29 10:48:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b51fc7b6-e869-525e-a098-dfc99aa20e17 with identifier: PX49171
2026-03-29 10:48:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b51fc7b6-e869-525e-a098-dfc99aa20e17 with scrape type 2
2026-03-29 10:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b51fc7b6-e869-525e-a098-dfc99aa20e17 with scrape type 2
2026-03-29 10:48:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b51fc7b6-e869-525e-a098-dfc99aa20e17, identifier: PX49171
2026-03-29 10:48:53 [auto1.de] INFO: Found listing with ID: GX76510
2026-03-29 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX76510%27 HTTP/1.1" 200 None
2026-03-29 10:48:54 [auto1.de] INFO: Scrape type for GX76510: 0
2026-03-29 10:48:54 [auto1.de] INFO: Found listing with ID: DT67052
2026-03-29 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT67052%27 HTTP/1.1" 200 None
2026-03-29 10:48:54 [auto1.de] INFO: Scrape type for DT67052: 0
2026-03-29 10:48:54 [auto1.de] INFO: Found listing with ID: ZZ82496
2026-03-29 10:48:54 [auto1.de] INFO: Found listing with ID: MA81744
2026-03-29 10:48:54 [auto1.de] INFO: Found listing with ID: KG50767
2026-03-29 10:48:54 [auto1.de] INFO: Found listing with ID: AR70360
2026-03-29 10:48:54 [auto1.de] INFO: Found listing with ID: YX36608
2026-03-29 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX36608%27 HTTP/1.1" 200 None
2026-03-29 10:48:54 [auto1.de] INFO: Scrape type for YX36608: 0
2026-03-29 10:48:54 [auto1.de] INFO: Found listing with ID: XL74124
2026-03-29 10:48:54 [auto1.de] INFO: Found listing with ID: WX78972
2026-03-29 10:48:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b51fc7b6-e869-525e-a098-dfc99aa20e17 with identifier: PX49171
2026-03-29 10:48:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b51fc7b6-e869-525e-a098-dfc99aa20e17 with identifier: PX49171
2026-03-29 10:48:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b51fc7b6-e869-525e-a098-dfc99aa20e17 with identifier: PX49171 to the API
2026-03-29 10:48:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 10:48:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 10:48:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:45:51Z',
 'fuel_type': 'diesel',
 'id': 'b51fc7b6-e869-525e-a098-dfc99aa20e17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX49171',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 244825,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-01',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-29 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX49171%27 HTTP/1.1" 200 None
2026-03-29 10:48:54 [auto1.de] INFO: Saving data for PX49171: {'auction_closing_time': 1774885551.0, 'created_time': 1774694448.945573, 'last_price_update_time': 1774781334.355298}
2026-03-29 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PX49171') HTTP/1.1" 204 0
2026-03-29 10:48:54 [auto1.de] INFO: Found listing with ID: AH24505
2026-03-29 10:48:54 [auto1.de] INFO: Found listing with ID: SU92609
2026-03-29 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU92609%27 HTTP/1.1" 200 None
2026-03-29 10:48:54 [auto1.de] INFO: Scrape type for SU92609: 0
2026-03-29 10:48:54 [auto1.de] INFO: Found listing with ID: RF00811
2026-03-29 10:48:54 [auto1.de] INFO: Found listing with ID: CA70430
2026-03-29 10:48:54 [auto1.de] INFO: Found listing with ID: CG16297
2026-03-29 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG16297%27 HTTP/1.1" 200 None
2026-03-29 10:48:54 [auto1.de] INFO: Scrape type for CG16297: 0
2026-03-29 10:48:54 [auto1.de] INFO: Found listing with ID: AZ56926
2026-03-29 10:48:54 [auto1.de] INFO: Found listing with ID: GY33643
2026-03-29 10:48:54 [auto1.de] INFO: Found listing with ID: PF97491
2026-03-29 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF97491%27 HTTP/1.1" 200 None
2026-03-29 10:48:54 [auto1.de] INFO: Scrape type for PF97491: 0
2026-03-29 10:48:54 [auto1.de] INFO: Found listing with ID: EK48004
2026-03-29 10:48:54 [auto1.de] INFO: Found listing with ID: WJ88731
2026-03-29 10:48:54 [auto1.de] INFO: Found listing with ID: GY05092
2026-03-29 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY05092%27 HTTP/1.1" 200 None
2026-03-29 10:48:54 [auto1.de] INFO: Scrape type for GY05092: 0
2026-03-29 10:49:06 [scrapy.extensions.logstats] INFO: Crawled 230 pages (at 4 pages/min), scraped 445 items (at 89 items/min)
2026-03-29 10:49:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 160MiB
2026-03-29 10:49:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:49:06 [auto1.de] INFO: Channel: 24h | Page: 169 | totalHits: 6726 | hits on page: 6
2026-03-29 10:49:06 [auto1.de] INFO: Found listing with ID: TW02363
2026-03-29 10:49:06 [auto1.de] INFO: Found listing with ID: HR58634
2026-03-29 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR58634%27 HTTP/1.1" 200 None
2026-03-29 10:49:06 [auto1.de] INFO: Scrape type for HR58634: 0
2026-03-29 10:49:06 [auto1.de] INFO: Found listing with ID: LM22131
2026-03-29 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM22131%27 HTTP/1.1" 200 None
2026-03-29 10:49:06 [auto1.de] INFO: Scrape type for LM22131: 0
2026-03-29 10:49:06 [auto1.de] INFO: Found listing with ID: YV43994
2026-03-29 10:49:06 [auto1.de] INFO: Found listing with ID: HY99539
2026-03-29 10:49:06 [auto1.de] INFO: Found listing with ID: UE63664
2026-03-29 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 10:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE63664%27 HTTP/1.1" 200 None
2026-03-29 10:49:06 [auto1.de] INFO: Scrape type for UE63664: 0
2026-03-29 10:49:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 10:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 10:49:08 [auto1.de] INFO: Channel: 24h | Page: 170 | totalHits: 6726 | hits on page: 0
2026-03-29 10:49:08 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-29 10:49:08 [auto1.de] INFO: auto1.de Batch config: batch 2/2
2026-03-29 10:49:08 [auto1.de] INFO: auto1.de Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 7, <ScrapeType.BATCH_SKIPPED: 5>: 10}
2026-03-29 10:49:08 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (445 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.de/task_18_2026-03-29T10_35_00.jl
2026-03-29 10:49:08 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 629462,
 'downloader/request_count': 232,
 'downloader/request_method_count/GET': 60,
 'downloader/request_method_count/POST': 172,
 'downloader/response_bytes': 30381242,
 'downloader/response_count': 232,
 'downloader/response_status_count/200': 232,
 'dupefilter/filtered': 1,
 'elapsed_time_seconds': 842.14742,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 29, 10, 49, 8, 573764, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 445,
 'log_count/DEBUG': 11030,
 'log_count/INFO': 14268,
 'memusage/max': 168431616,
 'memusage/startup': 147836928,
 'request_depth_max': 173,
 'response_received_count': 232,
 'scheduler/dequeued': 232,
 'scheduler/dequeued/memory': 232,
 'scheduler/enqueued': 232,
 'scheduler/enqueued/memory': 232,
 'scrape_type/batch_skipped': 3361,
 'scrape_type/new': 29,
 'scrape_type/price_update': 416,
 'scrape_type/skipped': 2959,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 232,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 4.679386621830858,
 'scrapy-zyte-api/mean_response_seconds': 4.782529254451972,
 'scrapy-zyte-api/processed': 232,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 232,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 231,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 232,
 'scrapy-zyte-api/request_args/httpRequestBody': 172,
 'scrapy-zyte-api/request_args/httpRequestMethod': 172,
 'scrapy-zyte-api/request_args/httpResponseBody': 232,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 232,
 'scrapy-zyte-api/request_args/sessionContext': 232,
 'scrapy-zyte-api/request_args/url': 232,
 'scrapy-zyte-api/status_codes/200': 232,
 'scrapy-zyte-api/success': 232,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 6766,
 'source/total_available': 6726,
 'start_time': datetime.datetime(2026, 3, 29, 10, 35, 6, 426344, tzinfo=datetime.timezone.utc)}
2026-03-29 10:49:08 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-29 10:49:08 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7efd289c5c50>
2026-03-29 10:49:08 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7efd28a4a450>